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SfeSCRiPljON 

CONTROL SYSTEM AND USER INTERFACE FOR 
NETWORK OF MPm DEVICES 

CROSS-REFERENCE OF RELATED A^UCATIONS 
\mm.\ This application is related to US. provisional application no, 60/288,317, 
filed may 3, 2001, which is incorporated by reference hereir&> 

FIELD OF THE INVENTION 
The invention relates to the field of consumer electronics systems and, 
more particularly, to apparatus, methods, and systems for centrally controlling the 
operation of devices within a network of consumer electronics systems, 

BACKGROUND OF THE INVENTION 
10003} The United States and other countries are quickly transitioning to digital 
television (DTV) to take advantage of high definition TV broadcasts. The US, in 
particular, is slowly moving away from and will ultimately abandon the analog 
television system. According to current timelines, the US government is calling 
for the termination of analog TV broadcasts by the year 2008. The use of an 
analog TV will require the addition of sehtop-box down-converters to change the 

o . sis ) the lows -performance analog format such TVs were 
designed to receive, 

jfHHMJ Accompanying the transition to DTV Is the integration of the IEEE 1394 
digital home-networking technology. IEEE 1394 enables DTV and other digital 
aevkAS 1 1 *, i 

ji j i t igita \ ai 

audio, and system control data. A home network system comprising such 

t,s *-e myriad of cables and connectors and separate 
remotes currently necessary to interconnect and control electronic devices for a 
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primary video display unit (PDCU) can be engineered to be the command center 
of a digital home network system, 

jOOOSj However, IEEE 1394 by itself provides no way to control conventionally 
wire IR s g \ai centre c d 2m log < t d 0 vi k 0 (AV) Je ces RC w ces) s ch 
as analog VCRs, DVD , bio id sale <e and A c elvers, and 

f * ?< < id of cables, co ne h rs and emotes 

necessary to connect and control a mixed analog and digital noma theater 
network system. The interconnection and control of such systems can be quite 
complex and n ~h For example, simply switching from a cahia broadcast to 
playing a movie on a DVD player may involve numerous device specific remote 
controls and several iterations through the different layers of control on such 
remotes. Such a task may require the user to switch between video Inputs on the 
TV, switch between layers on a TV remote control to power on and play the DVD 
player, and then, if the user has a AV receiver (AVR), switch between layers on 
the TV remote and shut down the audio output from the TV and switch to an AVR 
remote control to power up and output audio through the AVR or, if the AVR is the 
current audio output device, use the AVR remote control to switch between AVR 
inputs to output the DVD player's audio from the AVR, Completing such tasks is 
often fraught with frustration especially when the user is not immediately 
successful In being able to watch and listen to a movie being played on the DVD 
player. 

ii.KHiej Thus, it is desirous to be able to centrally and seamlessly control a variety 
)f electronic - < - 5 > > I * < ,v 5 no f < f> vi and 
provide an easy to use user interface (01) wherein the complexities of the control 
of such devices is transparent to the user, 

SUMMARY OF THE INVENTION 
: y< the present inventions comprise novel apparatus, methods, 
and systems for centrally and uniformly controlling the operation of a variety of 
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devices over a variety of protocols within a network system and, more particularly, 
a control system and uniform user interface for centrally controlling these devices 
In a manner that appears seamless and transparent to the user For example, in 
en entertainment system or a home theater network system (HTNS) comprising a 
mix of analog iR controlled (IRC) and digital 1394 audio-video (AV) devices, 
control and operation of the IRC and 1394 versions of an AV device appears the 
same to the user. 

fOOO&j In a preferred embodiment, a HTNS in accordance with the present 
invention comprises a primary display and control unit (PDCU) and a mix of IRC 
and 1304 AV devices and other inputs. The PDCU may comprise an AV system 
such as a television and, preferably, a digital television (DTV), having appropriate 
circuitry and programmable logic for operation of a control system in accordance 
with the present Invention. Alternatively, the PDCU may comprise a primary 
display unit such as a TV or a "dumb" monitor or display, and a dedicated 
controller or computer boused in a separate chassis from the primary display unit 
and comprising appropriate programmable logic for operation of a control system 
in accordance with the present invention. Preferably, the PDCU includes several 
I/O ports to which external or peripheral devices, such as the IRC and 1394 AV 
devices, may be coupled. 

|00O9 1 Numerous possible configurations of a HTNS In accordance with the 
present invention are possible. For example, the HTNS may comprise numerous 
IRC and 1394 devices and other system inputs Interconnected in a variety of 
ways to one another and to the PDCU. Preferably, the PDCU integrates IEEE 
1394 and EIA-775 technology as well as the Home Audio Video interoperability 
(HAVi) networking software technology and AV/C, which compliment the IEEE 
1394 technology, The 1394 devices are preferably connected In series and/or in 
parallel to the PDCU across 1394 cable, while the IRC devices are connected to 
the PDCU in parallel across conventional AV cables and controlled across IR 
blaster cables. The IR blaster cables enable messages or commands comprising 
device specific IR codes to be communicated to the IRC devices. 



3 



fOfiiftJ In one innovative aspect of the present invention, the PDCU includes a 
context sensitive control system thai enables centralized and seamless integrated 
control of both 1394 and IRC-fype devices, as well as internal TV-type inputs and 
other input devices and system hardware interconnected to the PDCU. As such, 
the PDCU is the command center or hob of the HTNS or other network systems 
that may comprise, in addition to entertainment AV type devices, home 
appliances and home lighting, heating, air conditioning, security-type systems, 
and the like. The control system preferably includes a control module that is 
capable of interpreting an input command such as an event signal from a system 
remote, determining what action needs to take place, for example, navigate 
through menus on the screen of the PDCU or operate an attached AV device, 
determining what devices to connect and how to connect them, and then 
preparing and sending device appropriate messages or commands to the input 
devices, Preferably, for supported iRC devices, the control module includes a 
library of IR codes and Is capable of translating a input command, sucb as a 
digital input command, Into a message comprising IR codes from the IR code 
library appropriate for the device, andl then blasting the command message to the 
IRC device to drive the IRC device- Tne control system of the present invention 
may also be capable of learning and/or uploading IR code of a vanety of IRC 
devices. All such operations, however, are advantageously transparent to the 
consumer or user. 

|00li| in another innovative aspect of the present invention, the control system 
Includes a versatile Icon based graphical user Interface (Ul) to provide a uniform, 
on-screen centralised control system for the network system. The Ul enables the 
user to transparently control multiple input devices such as infernal TV-type 
devices, AV devices, and other input devices over different protocols white 
operating on a single layer of a system remote control, e.g., the TV layer of a 
universal TV remote. For example, operation of an IRC DVD player and a 1 394 
DVD player appears Identical to the usee The Ul also advantageously provides 
on-screen, real time visual recognition of the state of the system, device 
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availability, operation or connection options, active connections, navigation, and 



on the screen of the 




and, wnen a recording or other peer4o-peer 
connection is active, a connection window. The user next navigates through the 
device selection window and highlights a device icon, such as a VCR icon, to play 
a movie on the VCR, The user may move or Jump to an audio selection window 
and highlight an AV receiver (AVR) Scon for audio output from an AVR. Selection 
of the VCR and AVR from the device selection menu by pressing the "enter* or 



s highlighted {selected), causes the control system to perform all 
<e all necessary connections and display a h 
n of the FDCU, The transport menu Is a device control menu 

"Ff'\ "RW", and the like. Alternatively, device spec?i'se control menus, i.e.. device 
supplied, may be displayable and operable through the control system of the 
present invention. Lastly, the user selects the play button in the transport menu 
by pressing the "enter" or "play" buttons on the system remote control to play the 
movie. The steps taken by a user would be the same whether the device is an 
IRC or a 1394 device. As noted above, the control system interprets and acts on 



necessary connections, in a manner that is transparent to the user. 
(01)131 A further innovative aspect of the present invention includes the connection 
permutation sensitivity of the control system. In particular, once a device such as 
the VCR is selected, the control system will automatically control it and the rest of 
HTNS based on stored device and device connection configuration data. For 
instance, if the VCR is connected to both an AVR and the PDCU, wherein the 
audio from VCR is to be outputted by the AVR while the video is outputted by the 
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POCU, upo ecti c 3 WR, tfi * n > < , s t 

1 ' J i i.f } f I > I 4 i . 1 * - * ! v 

Rwh < h ir vfihir WR if it is the currer 

audk out f or sink d< ce Thus he control ' - * < of IN 
nea switching trans pa >thei 1 one tent, context 

sennit ten o be supe tot > < i nand capability som 

remotes because the control sequences of trie control system are not dependent 
> lb v being srticular state at t ming of the 

ety - c i ~ f >> - - i f l con - 1 n es sea s pe< 
peer communication and operation such as recording between devices even 
>vhen the POQ I pi ly involved he necfion 
|0OI4| In yet another innovative aspect of the present invention, the control 
system includes a configuration setup subsystem. It provides users with the 
capability to setup the configuration or device Interconnections of the network 
system in a first time out of the boy Irvliai setup mode or the capability in 
change/modlfy/delete existing configurations in an edit mode. In the initial setup 

i fir urat on of device nput 

connections on the POCU and instructed to connect the IRC devices to the PDCU 
n.;ooro«! < i he user then logs in each IRC device within the network system 
and the control system builds a device list and device connection database. If the 
network system includes IRC devices interconnected to the PDCU through other 
input connections, the user may enter the edit mode of the subsystem to 
customize the input connections of such devices as well as delete individual 
device or entire system configuration data h« s n 
configuration setup subsystem is text and screen driven. In an alternative, 
navigation through the configuration -setup subsystem may be by voice 
recognition or the configuration setup subsystem may be graphically driven, 
\m\$\ In yet another innovative aspect. ?he control system preferably enables IR 
signal pass-huough comroi of non-supported IRC devices within the network 
system, while avoiding IR signal jamming. Avoidance of IR signal jamming may 
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be accomplished by appropriate signs! transmission gapping control or through a 
gated control system. Preferably, the gated pass-through control system includes 
a gate mechanism that controls the pass-through of IR signals to the non- 
supported IRC devices. An SRC device controller, which is adapted to translate 
remote commands 0 messages containing device appropriate IR code tor 
supported IRC devices,, controls the operation of the gate. As such, the IRC 
controller preferably maintains the gate in a closed state as the IRC controller 
transmits device specific IR code messages to supported devices When such 
transmissions are complete, the IRC controller may transition the gate to an open 
state to allow IR signals to freely pass to non-supported devices. 
(0GJ6j Other aspects and features of the present invention vviil become apparent 
from consideration ol too following description taken in conjunction With the 
accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 
)0O.I7| FIG, 1 is a diagram showing an example of a device interconnect 

ratio st a - ome theater network system of the present invention, 
(00181 2A is a schematic showing an example of a home theater network 
system of th ( ieiy of IRC 

and 1394 AV devices connected to the television, A graphical user interface of 
toe control system of too present invention is shown on the display of the 
television providing visual recognition of the current system state, user navigation 
through device and acd n ex. ' I active device 

connections, 

|00i9| FIG, 2B is a schematic showing the home theater network system provided 
in FIG. 2A, The graphical user interface of the control system shown on the 
display of the television provides visual recognition of current system state, user 
navigation through device and audio menus, device connection options, arid 
active device connections. 
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[0020| FIG. 2C is a 'schematic showing the home theater network system provided 
in FIG. 2.A.. The graphical user interface of the control system shown on the 

i - r <. em <- w^ . , <. ^ " Iv'c^jr 4 t < — oc user 

navigation through device and audio menus, device connection options, and 
active dev^e connections. 

10021] FIG. 2D is a schematic showing the home theater network system provided 
in FIG. 2A. The graphical user interface of the control system shown on the 
display of the television provides a device apprppfia$9 : cofT!^H'^n'^pQrt) menu for 
operation of a selected device. 

I.O022] FIG, 2E is a schematic shewing the home theater network system provided 

in FIG. 2A. The graphical user interface of the control system shown on the 

display of the television provides PIP device connection options. 

10023] FIG. 2F is a graphical representation of a preferred embodiment of the 

graphical user interface of the control system of the present invention, 

10024] FIG. 3A is a schematic of a remote control and a television in accordance 

with the present invention. 

p)2S| FIG, 3B is e schematic of the remote control and an alternative 
embodiment of the television shown in FIG. 3a including \R pass-through circuitry. 
(002S] FIG. 3C is a schematic of a remote control and a primary display and 
control unit in accordance with the present invention comprising a television and a 
separate HTNS controller, 

10027] FIG, 3D is a schematic of a remote control and a primary display and 
control unit in accordance with the present invention comprising a monitor or 
•display and a separata HTNS controller. 

]«028J FIG. 4 is a plan view of a remote control tor the home theater network 
system of the present invention. 

|PP2 !: t] FIG. 5 is a schematic ot a control system for the home Piaster network 
system of the present invention. 

(00301 6 is a schematic of a user interface module of the control system of 
the present Invention. 
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(0031) FIG. 7 A is a diagram showing a device log in menu for a setup 
configuration subsystem of the present invention. 

10032 1 FIG. 78 is a diagram showing a preferred embodiment of the device log in 
menu, 

|0033| FIG, 8 is s diagram showing a device connection review menu for the 
setup configuration subsystem. 

|0034] FIG, 9A Is a diagram showing a finish menu for the setup configuration 
subsystem, 

|0035] FIG. 98 Is a diagram showing an edit menu for the setup configuration 

10030] FIG. 9C is a diagram showing a device connection customization menu for 

|0037] FIG. 10 is a diagram showing a menu for initiating recording or peer-to- 

|0038] FiG. 1 1 A is a schematic of an IR. signal pass-through arid control system of 
the present Invention, 

|0039| FiG, 1 1B is a schematic of an alternate embodiment of the IR signal pass- 
through and control system. 

10040] FIG, 12 is a schematic of a remote control and television for the home 
theater network system of the present invention with an SR pass-torouoh and 

>ntroi system Incorpou i 
(004.1 } HG. 13 i$ a schematic of a control system tor trie name theater network 
system oi the present invention with an R p< * > 

m co r p o ra t eo i h o ro i n 
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}0«421 Referring in dotal 


1 to the figures, novel apparatus, methods, and systems 


for centrally and unifomr 


i!y control! 


ing the operation of a variety of devices over a 


variety of protocols withi 


;n a netwo 


rk system are described. In particular, a control 


system and user interfai 


;e that pre 




• t,o'j control of a r 


letwork of 


oavjces ovef a vanaxy protocols m& qe^tuoeu. 



It will be understood by those skilled In the art that numerous configurations of a 
network system in accordance with the present invention are possible. For 
example, a network system may comprise a mix of communication devices, 
consumer electronic systems, auascvvicieo {h>V) oevtcei>, mgn ano sow speed 
devices, analog and digital devices, globally and locally controlled devices, and 
AV and non-AV.devtoe*. and the like, and may comprise both analog IR 
controlled end digital 1394 AV and other input-type devices. For exemplary 
purposes only, the apparatus, systems and methods in accordance with the 
present inventions will be described primarily in the context of a Home Theater 
Network System (HTNS). 

|0043j in a preferred embodiment, a HTNS in accordance with the present 
Invention comprises a primary display and control unit (PDCU), which functions as 
the hub or command center of the HTNS, and a mix of IR controlled {analog} and 
1 394 (digital) AV devices, and other inputs. The AV devices and other inputs may- 
be interconnected in a variety of ways to each other and to the PDCU. The 
PDCU preferably includes an integrated control system with a graphical user 
interface <UJ) for making connections between components of the HTNS and 
controlling their operation. The control system provides the user with centui' $ - 
control of all of the supported devices in the HTNS and, in an alternative 
embodiment, enables pass-through control -of non-supported devices while 
avoiding signal jamming, 

mm Preferably, the PDCU comprises an AV system such as a television and, 
more preferably, a digital television (DTV), comprising appropriate circuitry and 
programmable logic for operation of a control sy *ten • cordance with the 
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present invention. Alternatively, the PDCU may comprise a primary display ont 
such as a TV or a "dumb" monitor or display, and a dedicated controller or a 
computer housed in a separate chassis from the primary display unit and 
comprising appropriate programmable logic for operation of a control system in 
accordance with the present Invention. For exemplary purposes only, however, 
the description that follows primarily describes the present inventions with regard 
to a DTV. 

{00451 Preferably, the control system of the present invention Integrates IEEE 
1394 and EIA-775 technology as well as the Home Audio Video Interoperability 
(HAVi) networking software technology ami AV/C, which compliment IEEE 1394 
technology. The control system also preferably incorporates a bi-directional 1304 
bus interface, which is compliant with IEEE 1394*1995 and SEC 61883-1, 
exchanges MPEG-2 video with other devices m accordance with ISC 61883-4, at 
HP and SO resolutions as described m IEC61 883-2, 3, 4, and exchanges digital 
audio as described in IEC 61883*6, which specifications are ail incorporated 
herein by reference. The control system also preferably functions as a 1394 bus 
cycle master, as defined in IEEE 1394-199S 8,3.1,4, a bus manager, as defined in 
IEEE 1394-1995 8.3.1.6, and an isochronous resource manager, as defined in 
IEEE 1394-1995 8.3.1 .5, provides higher-level 1394 interfaces to open cable and 
other AV/C devices as dofined in EIA-775A, and conforms to Profile B of 775A 
■■subscriber devices, which specifications are ail incorporated hereto by reference. 
Although capable of being configured to do so, the control system will preferably 
not respond to any type of 1 394 commands from other 1394 devices, in any 
protocol, and preferably does not conform to the HAVi Display Functional Module. 
The control system's Confjg ROM and SOD preferably identifies itself to other bus 
members that It does not support those sub-unit standards. In addition, the 
PDCU is preferably a full A/V device (FAV) as described in the HAVi 1 .0 
Specification, which specification is incorporated herein by reference. 
|0046| Turning to Fig. 1, an exemplary embodiment of a HTHS 10 in accordance 
with the present invention Is shown composing one of numerous possible device 
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connection configurations. As the hub of the HTNS 10 : the DTV 12 of the present 
of invention comprises a control system, with capabilities as discussed above and 
In greater detail below, that provides seamless integrated control of the miiim 
supported HTNS 10. Like conventional TVs, the DTV 12 includes a screen 11 
with main 13 and sub 14 (e.g., PIP, POP, etc.) video outputs, audio output 16 and 
a control panel 18 and numerous I/O ports to which input devices may be 
connected, and is preferably adapted to be controlled remotely by IR signals 
transmitted from a remote control device 20. Alternatively, the DTV 12 may be 
adapted to be controlled remotely by wireless RF transmissions, by voice 
commands via a voice recognition system, through a dial up modern connection, 
i a u: 



includes a plurality of IR controlled (IRC) devices 30, 1394 devices 40, including 
AV and others 1394 devices, and other Inputs such as a PC 22, antennas 17 and 
the like, interconnected to the DTV 12 and one another. The 1394 devices 40 are 
preferably connected in series and/or in parallel to the DTV 12 across 1394 cable 
49, while the IRC devices 30 are connected to the DTV 12 in parallel across 
conventional AV cables 31 and controlled in parallel across IR transmission 

comprising device specific IR codes to be communicated to the IRC devices 30. 
The DTV 12 preferably includes a library of device specific IR codes for supported 
devices and a control system that Is capable of translating a input command 
(digital or analog) from the remote control 20 into a device appropriate message 
comprising device specific IR codes, which is then communicated to the IRC 
device 30 to control and operate or drive the IRC device 30. 
rCMMSj As depicted, the IRC input devices 30 may include such devices as a cable 
box 18, a digital broadcast satellite tuner (DBS) 32 ; a video cassette recorder 
(VCR) 33, a digital video disk player (DVD) 34 and the like, connected to the DTV 
12 across AV cable 31 such that the audio and video outputs, or, optionally, Just 
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video output, from these devices may be inputted to the DTV 12, The IRC input 
devices may also include such devices as a IRC AV receiver {AVR} 3? with audio 
output from the DTV 12 being directed to the AVR 37 across an AV cable 31 . 
Although capable of outputting video to the DTV 12, the AVR 37 is preferably not 
configured to output video to the DTV 12. With an AVR 37 included in the HTNS 
10, the DBS 32, VCR 33 and DVD 34, or other IRC AV devices 35 and 36, such 
as a second VCR, a DVD and the like, may he connected to the AVR 37 and the 
DTV 12 such that their video outputs are directed to the DTV 12 and their audio 
outputs are directed to the AVR 37, In the alternative, although not preferred, 
these devices may just be connected to the AVR 37 with both their audio and 
video outputs directed to the AVR 37. 

|(HM9I As indicated above, the IRC devices 30 are controlled and operated across 
IR blaster cables 38. The IR blaster cables 38 of the present invention preferably 
comprise an electrical cable with an IR emitter connected to one end and a mini- 
plug for connection to the DTV 12 on the other end of the cable. The IR emitter, 
which Is preferably t-shaped, is preferably placed in front of or glued onto the IR 
detector of each IRC device 30 to communicate device specific IR code based 
messages to the IRC device 30. The IR emitter may include an opaque backing, 
which may block IR transmissions from other sources such as the remote. The 
blaster cable may, in the alternative, include a second mini-plug instead of an IR 
emitter for IRC devices 30 that have IR ports instead of or in addition to an IR 
detector, 

1<H)50| As depicted, the 1394 devices 40 may include such devices as a digital 
VCR (D-VCR) 41 , a digital camcorder 42, a digital DVD (D-OVD) 43. a digital AV 
(D-AVJ disc player 44, a digital AVR (D-AVR) 45, a digital (D^ cable or satellite 
receiver 4b, and the like, or other 1 394 compatible systems or devices 47 and 48 
such as home appliances and home lighting, heating, air conditioning and 
securtHype systems, and the tike. The 1394 devices 40 may include MAVi-type 
1394 devices and may be interconnected to the DTV 12 and one another in series 
or parallel across 1 394 cable -49. 

13 



tmsit As shown in Figs. 2A-2F, the DTV 1 2 of the NT MS 1 0 includes a control 
system composing an on-screen, graphical user interface (Ul) 50. The ill 50 and 
control system preferably include a device selection menu 52 preferably 
comprising graphically representative, on-screen dispiayabie Icons corresponding 
to the supported devices of the HTNS 10. audio and video input options, device 
output destinations, active In-use" device connections, and the like. The icons 
are preferably labeled with user U preferred names corresponding to the device. 
Operation and control of the supported HTNS 10 through the Ul 50 is seamless 
such that the control of a IRC VCR 33 and & 1394 VCR 41 appears identical to 
the user U. 

I0052J The device selection menu 52 of the present invention preferably includes 
a device selection window (device window) 80, a video window 70, an audio 
selection window (audio window) 80, and, If a recording or other peer-to-peer 
connection is active, a connection window 90, which are preferably labeled 
"DEVICE", "VIDEO", "AUDIO" and "CONNECTION" , respectively. As depicted, 
the device window 60 is preferably located toward the bottom of the screen 1 1 , 
while the video 70, audio 80, and connection 90 windows are preferably located 
toward the top of the screen with the video and connection windows 70 and 90 
located toward the upper left corner and the audio window 80 toward the upper 
right comer. One of skill in the art would recognize that the device selection 
menu 52 may include any number of windows and is not limited to the device, 
video, audio and connection windows 60, 70, B0 and 90 discussed above or their 
orientation or location on the screen. 

|t)053| Icons corresponding to the IRC and 1304 input devices 30 and 40, such as 
a DBS tuner Icon 61, an antenna Icon 02, a VCR icon 63, a DVD icon 04, a 
generic IRC AV device icon 05 ; a D-VHS VCR icon 66, a D* cable or satellite 
receiver icon 67, a D-DVD icon 88, a D-AV disc icon 69, and the like are 
displayed In the device window 60 as AV source or input device options. An icon 
72 corresponding to the TV video icon 72 is displayed in the video window 70. If 
other video sink or video output display devices are incorporated within the HTNS 
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10, icons corresponding thereto may preferably be displayed in the video window 
70 or as part of a pull down menu. Icons corresponding to the audio sink or audio 
output devices, such as the TV audio icon 82, an IRC AVR icon 84 and a 1394 
AVR icon 88, are displayed in the audio window 80. If a recording or other peer- 
to-peer connection is active, scons corresponding to the destination or sink 
devices, such as the VCR icon 92 as shown in Pig. 28 or the D-VHS VCR and AV 
Disc icons as shown in Fig. 2F, are displayed in the connection window §0. The 
windows may be configured to display all device icons at once or, as preferred, 
configured to limit the display to a subset of all of the icons In an initial view with 
window scrolling, paging or pulkJown capabilities to view the remaining icons. 
\W$4) Incorporated within the Ut 50 is an intuitive, on-screen, head-up, real-time 
visual recognition system. The visual recognition system preferably visually 
communicates to the user U the current system state Including active "irvuse" 
connections, input device options, audio output options, video destinations and 
output options, peer-to-peer connections, and navigation selections as the user U 
operates the controls on the remote 20 or control panel 18 and displays or 
navigates through the device selection menu 52, The visual recognition system 
of the present invention may employ a variety of visuai display indicators such as 
highlighting the exterior of the icon with light, different colors, different line types 
or the like, changing the Icon color, fill pattern, or the like, graying or crossing out 
the icon, providing textual indicators, and the like, to visually indicate the system 
status, input and connection options, destinations, navigation, peer-to-peer 
connections and the like, in a preferred embodiment, the states or conditions of 
visuai recognition include "disabled", "current device" and "current menu selected 
icon" (or menu location), and more preferably: (1) current menu selected icon and 
current source or sink device (primary and secondary highlighting): (2) current 
menu selected icon and not current source or sink device (primary highlighting); 
(3) not current menu selected icon and current source or sink device (secondary 
highlighting); (A) not current menu selected icon and not current source or sink 
device (no highlighting); (5) not available or disabled (tertiary highlighting, e.g., 
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grayed out). The icons themselves may be configured to convey additional 
information such as power slate, channel transport state or action (e.g., a 
dynamic motion icon indicating the device is playing), and the like. 
0055] Refornn < 1 >c3i >l | i * f ) 

is depicted. A primary highlight, shown as a hold outline about the D-VHS VCR 
and D-AVR icons 88 and 88 in Fig, 2A, the SRC AV device and TV audio icons 85 
and 82 in Fig. 28, and the DVD and AVR Icons 84 and 84 in Fig. 2C, may be 
used to Indicate the currently selected icon while navigating through the device 
and audio windows 60 and 70. If the connection window is made navigable, a 
bold outline about an icon in that window may be used to Indicate the currmi 
menu selected connection Icon for possible connection cancellation* A secondary 
highlight, shown as a cross-hatch within the D-VHS VCR, TV video, and D-AVR 
scons 88, 72 and 88, may he used to Indicate the current AV source device, the 
current video sink device and the current audio sink device. A tertiary highlight, 
shown as a graying-oui of the DBS tuner and AYR icons 61 and 84 In Fig. 2A and 
the DBS tuner and D-AVR icons 61 and 88 in Figs. 28-2C, may be used to 
indicate that a particular device Is unavailable or disabled. No highlighting, 
however, may be used to indicate a device is connected to the HTNS 10 and 
available for operation and connection to other devices, but is not the current 
source or sink device or menu selected device icon. In addition, primary 
highlighting, shown as a bold outline about device window 80 in Figs, 2A-2B and 
audio window 80 in Fig. 2C, may be used to indicate the window in which the user 
is currently navigating, 

\mm\ Turning to Fig. 2F, a preferred embodiment of the 01 1050 of the present 
invention, with its device selection menu 1062 and visua! recognition subsystem, 
is shown displayed on a screen 101 1 of a DTV or some other primary display unit, 
The Ui 1050 preferably includes device specific graphically representative and 
appropriately labeled icons corresponding to the supported devices connected to 
the HTNS, the video sink or output device, the active connections, and the audio 
sink or output devices. For example, the icon 1081a for a D8S tuner includes a 
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picture of a satellite dish and a name label 1061b of "DBS". Similarly, icons for 
antennas preferably include a picture of an antenna, VCR icons preferably include 
a picture of a cassette tape, video camera icons preferably include a picture of a 
camera, AV receiver Scons preferably Include a picture of a stereo, TV icons 
preferably include a picture of a TV, and the like. In addition to a device name 
label 1061b, the icon may Include a device type label such as a 1 304 label 1063a 
oraHAVi label 1063b. 

[0057| As part of the device selection menu 1052, the icons are preferably 
displayed within a device selection window 1060 that includes a window label 
1062 of "Device", a video window 1070 that includes a window label 1071 of 
"Video", an audio selection window 1080 that includes a window label 1081 of 
"Audio", and, If a recording or other peer-to-peer connection Is active, a 
connection window 1080 that includes a window label 1001 of Xonnectloo''. The 
eon?seciion window 1000 may be dispiayable whenever there is an active 
recording or peeMo-peer connection, or only dispiayable whenever there is such 
a connection and the icon corresponding to the source device of the connection is 
the currently selected during navigation through the device selection window 
1060; see the Ant A icon In device window 1060. A primary highlight 1085 and 
1083 such as outlining an Icon in a particular color, e.g., yellow, which in Fig. 2F 
is shown as a different shaded outline about the ANT A and AVR icons, and/or 
changing the color of these icons' device name labels 1067 and 1082 to a 
particular color, e.g., yellow, is used to indicate the currently selected device icon 
while navigating through device and audio windows 1080 and 1060. A secondary 
highlight 1064, 1004 and 1072 such as changing the color of the Icon to a 
particular color, e.g., gold, which Is shown in Fig. 2F as a change in the shading 
or lighting of the CABLE, AVR and TV icons, is used to indicate the current AV 
source device, audio sink or output device and video sink or output device. A 
tertiary highlight 1067 and 1008, such as graying out of an icon and its label In the 
device or audio windows 1080 and 1 080 , is used to indicate that a particular 
device Is unavailable or disabled. The use of no highlighting, however, is used to 



17 



WO i©)'iUH 



indicate a device is connected to the HI US and available for operation and 
connection to other devices, In addition, the use of primary highlighting 1068 
such as outlining the device or audio window in a particular color, e.g., yellow, 
which is shown as a different shaded band about the device window 10S0 in fig. 
2F, may he used to indicate the window in which the user is currently navigating, 
WISH] Fie. 2D shows a transport menu 54 of the Ul 50 displayed in the main 
video 13 on the screen 1 1 of the DTV 12. The transport menu 54 is a device 
control menu preferably comprising common device appropriate control function 
buttons such as "play", TF*> "PW, and the like. Primary highlighting, shown as a 
held outline of the arrow on the "play" button, may be used to indicate the current 
function button selected while navigating within the transport menu 54. Tertiary 
highlighting, shown as the graying out of the "record" button 55, may be used to 
indicate that a function is not available or not supported by the currently selected 
device, 

|0S5$] Turning to Fig. 2E, a PIP device selection menu 152 of the Ui 50 of the 
present invention is shown displayed in the main video 13 on the screen 1 1 of the 
DTV 12. The PIP device selection menu 152 comprises a PIP device selection 
window 160, which is substantially the same as the device window 60 of the 
device selection menu 52, and a PIP video window 1 70. A PIP icon 172 in the 
PIP video window 170 corresponds to the PIP or sub picture 14 of the screen 1 1 
of the DTV 12. A primary highlight, shown as a bold outline about the VCR icon 
83, may be used to indicate the device icon currently selected while navigating 
through the PIP device window 180. A secondary highlight, shown as a cross- 
hatch within the DVD and PIP video icons 84 and 172, may be used to indicate 
the current AV source device and the current video sink device, i.e., the sub 
picture 14 of the screen 11 of the DTV 12. A tertiary highlight shown as a 
graying-out of the D-VHS VCR Digital Cable or Satellite Receiver, Digital DVD 
and Digital AV Disc device icons 66-89, may be used to indicate that the device is 
unavailable as a source for PIP video. For example, if a digital source can not be 
used as a PIP source when the video signal to the main picture 13 of the DTV 12 
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to indicate they are not available as a MP device option. No » 4 u K t ri 

howevei may be used t< a evice is coi > !% * v NSIO and 

in Pip ,<ideo source device 
p.H%0| Fig. 3A shows a schematic diagram of an embodiment of the DTV 12 of 
the present invention. As depicted, the DTV 12 preferably comprises an IR signal 
detector 103 for detecting IR event signals transmitted from a remote control 
device 20, The IR detector 103 is preferably coupled io a signal amplifier 104, 
which, in turn, is connected to a TV control (TV micro) circuit board 103. The TV 
micro 105 includes programmable logic, such as software, to control TV specific 
task and functions such as the dock, audio output, video output, volume up and 
down, channel up and down, I/O port switching, and the like in a manner similar to 
conventional TVs. In a preferred embodiment, the TV micro 105 decodes 
incoming commands, including those from the control panel 18, and acts to filter 
OOfcalK i - f ^ e HTNS of the present 

invention and forward intended signals to the HTNS control (digital module) 
processor or circuit board 100. The HTNS control circuit board 100 Is coupled to 
foe TV micro 105 and comprises a main computer processing unit (CPU) 102. a 
memory' moduie(s) 106, and a IRC device (IR blaster) control processor 134, 
which s conne loo t< an IR signal emitter (blasts epea er) 135 The IR blaster 
135 is used to transmit IR signals to externa; IRC devices. The HTNS integrating 
control subsystem or digitai module of the control system of the present invention, 
which Is discussed in regard to Figs. 5 and 6, includes programmable logic 

n corpomi e< in in r; • rcuit board 100 and/or, as in a preferred embodiment, 

software programmable logic that runs or operates on the digital module circuit 
board 100. Although depicted es separate circuit beards, one skilled in the ah 
would understand that the TV micro 105 and the control circuit board 100 may be 
combined as one circuit board.. 

JO061J Figs. 3B-3D show alternative embodiments of a PDCU of the present 
invention wherein like elements are labeled accordingly, in Fig. 38, the DTV 12', 
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as depicted ; includes IR signal pass-through circuitry comprising a second IR 
detector 401 c c ^ to an IR repeater 41? With t^is c rcuitry, the 

DTV 12' may transmit IR signals received by the detector 401 to external devices 
without any translation or decoding. In the alternative, the IR repeater 412 and IR 
blaster 135 may be combined as a single emitter/transmitter. 
|O062l As shown in Fig, 3C, a PDCU 12" of the present invention may comprise a 
TV 450 and a HTNS controller 452 coupled to the TV 450, The TV 450 may be a 
conventional TV having an IR detector 401 connected to an amplifier 403, which 
is connected to a TV micro 105. The TV 450 may also comprise an IR repeater 
412 to transmit IR signals received by the IR detector 401 to external devices. As 
depicted, the HTNS controller 452 preferably comprises an IR signal detector 103 
for detecting IR event signals transmitted from a remote control device 20. The 
IR detector 103 is preferably coupled to a signal amplifier 104, which, in tern, is 
connected to the HTNS control circuit board 100. The circuit hoard 100 may 
include a decoder that acts to filter out all IR signals not intended for the HTNS 
controller 452.. The HTNS control circuit board 100 preferably comprises a main 
computer processing unit (CPU) 102, a memory moduie(s) 108, and a IRC blaster 
control processor 134, which is connected to an IR blaster 135. The IR blaster 
135 Is used to transmit IR. signals to external devices. The HTNS Integrating 
control subsystem or digital module of the control system of the present Invention 
preferably includes programmable logic incorporated in the control circuit board 
100 and/or, as in a preferred embodiment, software programmable logic that runs 
or operates on the digital module circuit board 100, 
iwm] R f a « 3 i » si c iii coupled t 

a "slave" monitor or display screen S. The HTNS controller 404 preferably 
comp ses an IR Select i b' w * :ied tc > auu fi s *4 wbicl scon acted 
sea Secede; 108 tbat acts to fiiR ut all R s ais not ntended for the HTNS 
controller 454 and forward Intended signals to the HTNS control circuit board 100, 
One of bHi nth art woi 2 understand - ' > ec >de 108 could be com h i 
with the HTNS circuit board 100 as a single circuit board. The HTNS control 
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circuit board 100 preferably comprises a main computer processing unit (CPU) 
102, a memory moduie(s) 106, and a SRC blaster control processor 134, which is 
connected to an SR iter 1 Ih R blaste 35 is us o transn 
to external devices, The HTN5 integrating control subsystem or digital module of 
the control system of tbe present invention preferably secludes programmable 
logic incorporated In tbe control circuit board 100 and/or, as in a preferred 
embodiment, software programmable logic that runs or operates on the digital 
module circuit board 100. Alternatively, the HTNS controller 454 may comprise a 
conventional computer upon which the control system, in the form of software 
programmable logic, operates. 

|(MKs4| Turning to Fig. 4, an SR signal emitting remote control 20 of the present 
invention is shown. As depicted, he remote 20 includes many of tbe same 
function keys and buttons, for example, number keys, channel up and down, 
volume up and down, power, mute, PIP/POP, play, stop, FFWD, REW, adjust, 
and the like, as conventional universal remote controls, and tends to operate In a 
like manner. The remote 20 includes a control layer lever switch 21 to enable 
switching between layers to control a TV and other devices such as a cable box, 
a digital TV. a digital broadcast satellite luner, a VCR, a DVD or an audio device, 
However, when used with the control system of the present invention, the remote 
20 may be operated on a single layer, i.e., the TV control layer, to control and 
operate supported devices within the HTNS 10. Preferably, the remote 20 also 
includes HTNS specific function keys or buttons. The HTMS function keys and 
buttons include a device key 28, which may be used to display the device 
selection menu §2 of the Ul 50 of the HTMS 10 on the screen 11 in the main 
video 13 of the OTV 12 and navigate within the device window 60. The adjust key 
29 N i> dso be used t< b 1 e and a » v-ndows 80 and 

80, as well as the video and connection windows 70 and 90 to the extent these 
windows are navigable Other HTNS specific, function keys and buttons include 
audio, video and connection buttons 26, 24 and 23, which, along with device key 
28, may be used to toggle between the device and the audio, video and 
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connection windows 80 and 80, 70 and 90, The remote control 20 also includes a 
PIP device button 27, which may be used to initiate the selection of a PIP input 
device from a PiP device selection menu, shown in Fig. 2E. The record end 
connect buttons 25 and 23 on the remote 20 may be used to initiate recording 
ana other peerdo-peer eonm « e (input) and sin ) j 

devices. The record button .25, like the "enter" button, may also be used to initiate 
recordings. The recording and ether peer-to-peer connections may be over 
physical connection paths that include the DTV 12 or over connection paths that 
de net include the DTV 1 2 Far recording between a digital 1394 source device 
and an analog sink device, the DTV 12 preferably incorporates a down-converter 
to enable such recordings, 

|0O0j As shown diagrammatic-ally in Figs. 5 and 6, the DTV 12 of the present 
invention includes a control system 101 comprising a remote control device 20, 
an IR detector {receiver) 103, a TV micro 105, and a HTNS integrating control 
subsystem or digital module 110, The IR detector 103 receives and amplifies the 
IR signal, which is then decoded by the TV micro 105. The TV micro 105 
pnaefably filters out IR cod sterva 2 DTV 12 < present invention. 

The IR codes intended for the DTV 12 are communicated to the digital module 
board 100 where they are acted upon by the digital module (DM) 1 10. The DM 
110 is responsible for directing AY signals from external and internal devices to 
the main picture 13 and sub picture 14 of the DTV 12, or to one or more recorder 
or Sink devices within the HTNS 10. 

imm\ The DM 1 1 0 of the present invention advantageously enables centralized 
and seamless in!egmied nonce! of the enme supposed HTNS 10 including the 
s ' x ^ N ^ -u * n * x „ > fevcefa as aal< as uht,r 

inputs and system hardware interconnected to the DTV Including 1304 compatible 
home appliances and I s urea lionlnc sec; ty-typ< systems 

and the like. The DM 110 makes tne entire operation and control of the 
supported devices within the HTNS 10 very user friendly, A user U can configure 
the control system 101 and, more particularly, .the DM 110 with IRC device and 
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device connection information and the user's preferences of 1394 devices within 
Hie NIKS VutMh.s ; ' - vino and 

device operation for the user. For instance, the DM 1 10 and UI 50 wi present 
the user with a list of choices to watch, the user If can select between these 
choices and rely on the DM 1 10 to do the necessary I/O port switching and device 
connecting. 

IWm] With the DM 1 10 and Ui 50, the user may advantageously operate ail 
supported devices within the HTNS 10 with oca remote control device on one 
layer, e.g., the TV layer of a universal remote control. The DM 110 and UI 50 will 
manage the details of communicating with external devices, whether IRC or 1394 
devices, or a hybrid thereof. The DM 110 translates the commands from the 
remote as appropriate arid issues commands in the language appropriate for the 
device being controlled, giving common, intuitive behavior' across devices from 
within the HTNS 10. As a result, the user can use the same remote buttons to 
operate 1394 and IRC devices. While the remote control commands are being 
v >ternal devices, the UI 50 may prefe,\> - - . )mecmscraen 

indicator, 

{00681 The DM 1K i ncoming 

Signals, such as < jltai IR slg o? k i ti dependent, context 

sensitive macro function. For example, in order to play a movie on a DVD with 
sudio connected to an AV receiver input, the DM will switch Of necessary) the AV 
receivers input and the OTV's Input. The DM110 will automatically switch audio 
to follow the video signal and do whatever other switching is necessary to output 
the DVD's audio. Further, the DM 110 may issue commands In the correct 
languages tor the DVD and me AV receiver The actions taken by Hie DM 1 10 
v v ^ > j <- > n mf<u,i a \"* on the 

current system state. Following the user entered configuration of AV receiver 
t ! % tl M ) >iea switch •) ts < <> ; i\ J nd digita 

sources. For AV receiver models that require it, the DM 11 0 may send a 
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command when ne? essar> * > sw tc - an AV receiver inpf I ■ analog and 
dsgitaf. 

g in detail tc ? 1 4 ^ - c s i odules of t 

DM 1 10 preferably include an inter -processor communication module {IPC} 107 to 
enable communication between the DM 1 10 and the software or other 
programmable iogic of the TV micro 106, a user interface module (UIM) 1 1 1 : a 
1394 control module 120, a 1394 driver module 124, a IR control module 130, an 
IR blaster control module 134, and a TV control (TVC) module 140. The UIM 
1 1 1, which provides the context sensitive macro capabilities of the DM 1 10. 
transiaf.es incoming event signals from the remote or TV control panel and, based 
on stored configuration data and current system state information, Instructs the 
1394, IRC and TVC modules 120, 130 and 140 s as to what actions to take. The 
UIM 111 preferably comprises an AV connection manager (AVCM) module 1 12, a 
graphical user interface (GUI) module 114, and a device management system 
(DMS) module 118. The AVCM 1 12 and GUI 114 modules act in combination as 
an men ) I; tlon layer to interpret the event signal commends from tne 

mot t m co nmands into instructions for the OMS 1 16 and 

TVGM 140 regarding what actions to take. 

JW7Q| Preferably, the function of the AVCM 112 Is to determine the current state 
of the HTNS 10 by querying the DMS 118, TVCM 1 40 and TV micro 105 as to 
devices connected to tne system, active "in-use" device connections, active AV 
switching within devices and current TV operating parameters. For example, the 
AVCM 1 12 may determine from the DMS 118 that the active connections include 
an IRC cable box connected to the DTV, the video of a IRC VCR connected to the 
DTV and its audso connected to an AVR, and a D-DVD connected peer-to-peer to 
a 0-VCR. from tne TVCM 140 that the VCR's video is being directed to the main 
video of ti i - j g directed to the sub (PIP) video of the 

DTV and the device selection menu Is currently displayed on the main video of 
the DTV, and from the TV micro 105 that the DTV ! s audio output is switched off. 
Once the system statsis datenmlned, the function of the AVCM 1 12 is to 
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determine or interpret, based on the system state, whether an event signal is 

rornar.ci i 5 ti as rsenu 

display, menu navigation or menu device action, if the event is a direct device 
action, me AVCM 1 12 instructs the DMS 1 1 6 and/or the Tv'GM 140 directly as to 
what device action is needed in a message that includes the current system state 
information. For example, if the video and audio of an Ant tuner were being 
output by the TV video and a receiver audio, respectively, and the user U pressed 
the 'Volume up" key on the remote control, the AVCM 112 would instruct the DMS 
116 directly to raise the volume of the receiver audio. If the event is a menu- 
related action, the AVCM 1 12 communicates the event signal along with the 
current system-state information to the GUIM 1 14. 

{0071} The GUIM 114 includes the Ui 50 for the HTNS 10 and also the US for the 
DTV 12, preferably expressible as graphical window objects. The function of the 
GUIM 1 14 is to determine or interpret whether the event requires the display of a 
menu or navigation within or between menus, or Is a menu device action. If the 
event requires a device action, the GUIM 114 instructs the DMS 118 as to what 
device action is needed in a message thai includes the current system state 
Information, If the event requires menu display or navigation: the GUIM 1 14 
Instructs the TVCM 140 to display the menu in the main video 13 on the screen 
11 of the DTV 12 with the current system state information, if the AV input signal 
being displayed in the main video 13 is an analog signal from an IRC device 30, 
w v i s;gnal and the? transmits ig a to 

*- P> sss i 5 ! ut and menu display pals at 

the TV chassis of the DTV 12. In this instance, the menu appears opaque on the 
screen 11 . If the AV Input signal Is a digital signal from a 1394 device 40, the 

u - n\ v. m s combined vv th the input signal in the TVCM 140 and then 
transmitted to the TV chassis. In this instance, the menu preferably appears 
translucent on the screen 1 1 

|00?2| The function of the DMS 1 16 is to determine based on currant system state 
information and the device action instructions received from the AVCM 112 or 
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6UIM 114, what devices to connect and operate, what device connections to 
break, how to accomplish the device connections and disconnects, and how to 
operate a particular device. As pad of this function, the DMS 116 maintains, 
internal to the DMS 116, a device container list (DCL) 11? and a device 
interconnect list (OIL) 1 18. The DCL is a list, or database, of ail the supported 
devices that make up the H'T'NS 10, including internal TV devices such as tunem. 
I/O ports and the like, external input IRC and 1394 devices, and other input 
devices connected to the DTV 12. information about each device is placed into a 
device container object (DCO), which is stored in persistent memory 106. The 
DCO consists of a variety of information common to ail devices regardless of 
device type, including such information as a logical device ID ?o keep track of the 
device in the system and used to link device icons to the appropriate device DCO, 
a model number ID to identify which device model object (DMO) is associated 
with the device, and for IRC devices, identify an IR code fife, and an indication of 
whether the device is a 1 394 device or not, etc. 

(00731 While DCOs for infernal TV devices are created in advance and stored in 
ent memory, DCOs f * tc es are created by the DMS h 

during <.,om ? , n ^ n - < ^ < ^ m 
* ^ c ^ < ! * ""in 

the DTV 12. As part of creating the DCOs, the DMS 1 16 assigns each device a 
logical device ID and a DMO number to the device as pad of the DCO and notes 
whether or not the device is a 1394 device. 

(00741 Upon system initialization, i.e., after AC power Is applied to the DTV 12. the 
DCOs stored in persistent memory are read from storage by the DMS 1 16, an 
appropuu? x * x w i > O bas« d on the 

mode number ID ! f s! N nd t e >< C DMO > pia J 

in the DCL 117, Because 1394 devices are considered by the control system to 
be unit devices compos a; sul < t fc ably up to 32 sub- 

units), the DMS 116 creates both a unit level DCG/DMO and a sub-unit level 
0 ( DlvtO Each DCO/DMO sut>unit is linked to a common unit* 
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thai represents the device as a whole. For example, a 1394 device might consist 
of a Tuner and an AvDisc sub-unit. Each sub-unit has a DCO/DMO created for It 
and these two sub-units are linked to a DCO/DMO that represents the device as a 
whole. The sub-unit DCOs are not stored in persistent memory and are re- 
discovered each time the device is found on the 1 394 network. As a result, when 
a 1394 device is discovered,, the DMS 1 16 scans the DCL 117 for a DCO/DMO 
for thai particular device, if the DCO/DMO is in the DCL 117, then only the sub- 
unit DCO/DMOs are created and attached to the unit level DCO/DMO in the DCL 
117, If the DCO/DMO is not in the DCL 117, then the unit and sub-unit level 
DCO/DMOs are created with the unit level DCO/DMO added to the DCL 1 1 7 end 
unit level DCO added to persistent storage* 

[0075] The DMOs, which are embedded in the DMS, include device-type specific 
information common for all VCR4ype devices, DVD-type devices, etc, The DMS 
116 creates and maintains each instance of a DMO that understands the details 
of connection and communication with a particular AV device, whether it Is an 
irrtsmal TV device or an external device. The DMOs comprise a collection of 
device specific functions that know how to interlace with the input device. The 
DMOs in e's capability I. not limited to, hw 

to control the device, what functions the device can perform, which functions the 
device cannot perform, and all the I/O capabilities of the device. Remote 
commands, routed to the correct DMO, tell what the user wants to do to that 
device. The DMOs also proferaDiy comprise information on how to interface with 
the appropriate control module corresponding to the device. The information 
cone h MOs is pin - < for the IR orsk -of each 

device-type. Some of the information, however, such as audio arch video 
. i > v h< - - , v doess, stereo/mono, and the like, may be user 
modifiable, 

[mm] With the sppropriate DMO appended to the DCO, the DCO/DMO contains 
information that is needed to control the device and support the DIM 111. 
Accordingly, the DCO/DMOs preferably comprise information such as a unique 
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device dent ice ID), a or Number) a 

viewer's preferred «« me * we $ preface c ID > N * 
source, video/audio sink, video/audio record sink, or AV switch), AV pathway 
(analog, digital, both), digital pathway protocol.. Ui menu pathway, pern&ri#nt, 
ignore and connected to diss flees, preferred audio settings, preferred vitteo 
settings, preferred format setting, and the like. 

|O077] The Dll 1 18 is a list, or database, of all the physical device connections in 
the HTNS 10. The Oil 118 contains all of the device connection ports and 
connection paths between the ports in the HTNS 10. To create a connection port, 
the I/O capabilities of a device are obtained from the DMOs. Each connection 
port is placed into a device interconnect object (DiCn, which is stored in persistent 
memory. The information provided for a port by the DMO preferably includes pott 
cumber, content - video, audio or both, direction - Input, output, or recording input, 
and type - analog or digital. The DIL 116 also maintains the active In use* 
connections between devices when an AV source is actively connected to an AV 
sink. Active connections cor; move along the physical connection paths and pass 
through AV switch devices. Preferably, the chassis of the DTV 12 of the present 
invention is modeled as an AV switch device and the majority of AV connections 
ipass through it Active connections can come and go as the user changes AV 
sources and sinks, but physical connections always remain intact. The QMS 116 
can establish active connections from a source to a sink even If the video and 
audio take different paths. 

|W78| As part of the configuration system, 1394 devices are preferably 
automatically connected to a 1394 virtual switch DCO.'DMO. The virtual switch 
has an unlimited number of I/O ports. Thus, when a DIG for a 1394 device Is 

eat s DiO is ed i l oe;t xt the connection 

informat«on between the device ana the virtual switch is established. Connections 
I • sen the virtual switch and the de\ - are - - ns dered by ok QMS 1 16 to be 
physical connections, 

10079! The BUS 116 also maintains an IR Device list, an AVR Input Name list, 
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and an AVR Input Default list. Upon system Initiation, a list of all IRC devices Is 
read from persistent storage and placed into the §R Device List. Each entry in the 

st contai everal fu f informs > \ coifed to, De. I yr. 

{VCR, DVD, etc). Model Number (a unique number). Manufacturer Nam©, 
Manufacturer Model Name, IR Blasting Filename, and a set of special function 
flags, A list of AV Receiver input names is also read from persistent storage and 
placed Into AVR Input Name List, lastly, a list of AV Receiver default input 
settings is read from persistent storage and pieced into a list caiied trie AVR Input 
Defaults List, These defaults are used during the Initial setup configuration 
operation, There is also a collection of IR Code flies that contain the actual IR 
Codes for each remote control device key that is supported for each- device. 
There is one file for each device. The IR Code files are stored In persistent 
storage, 

{0880J As part of the setup configuration system discussed below, the GUM 114 
uses the Manufacturer Names and Model Names from the IR Device list for 
presenting IRC devices to the user for selection when adding a new device. The 
AVR Input Name List is also used by the GUIM to present the AVR input Names 
to the user in the Connection screen discussed below, When the Manufacturer 
and Model are selected, a uniquely Identifiable Model Number is created for the 
device. When a DCO/DMO Is created by- the DMS 1 1 6 that will use the IRC 
module for communication, a message is sent to the IRC modulo 130 that 
associates a Model Number with an.IRCo.de File, The IRC module 130 then 
loads the IR Code File data from persistent storage into memory (IR Code 
Library) for future use and associates the specified Model Number with that set of 
iR Codes. The Model Number and IR Blasting Filename is used by the QMS 1 16 
to foil the IRC module 130 specifically what to blast when a command or message 
to blast is received IRC module. The message or command will include the 
Model Number and the Key Code to blast. 

\W&%1 With the current system state and the required device action known, the 
DMS 1 1 6 accesses the DCL 1 1 ? and OIL 1 18 to retrieve specific information from 
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the OCO/DMDs and DJOs necessary to make and break connections between 
devices, operate switching between I/O ports of an AV switch, operate specific 
devices and interface with appropriate control modules. From this information, 
the QMS 116 formulates instructions or messages that are communicated to the 
1394, IRC and TV control modules 120, 130 and 140, and the TV micro 105 to 
accomplish the requested device action. All instructions or requests for operating 
the AV switches of the DTV 12 are sent via the TVCM 140 to the TV micro 105. 
The DMS 116 also modifies the OIL 1 18 to reflect the new active "sn-use" device 
connections, 

|0083| The function of the input device control modules 120, 130 and 140 is to 
transmit. > > < < t ' ' ^ i { u t 

device in a device appropriate manner. The DM 110 of the present invention, 
However, supports a wide variety of the 1394, i.RC and internal TV AV devices ~ 
e.g., camcorders, DVD players, VCRs, and set-top boxes, audio 
decoder/amplifiers, antenna tuners, AV receivers and the like. To communicate 
and control a wide variety of 1394 devices, the 1394 control module 120 
preferably maintains a device control module (DCM) 122 for each 1394 device 
within the HTNS 10. The DC-Ms 122 are software that takes the commands or 
instructions from the DMS 116 and transforms them to a device-specific message. 
Therefore, with DCMs 122 for every 1304 device, the DM 1 10 can pass remote 
commands such as change channels, PLAY, STOP and the like, to the DCM for 
that device end nave the commands transmitted to the device in 3 device specific 
way via a 1394 driver 124. The 1394 driver provides appropriate interfacing 
between the 1394montrol module 120 and external 1394 devices 126. 

hs DV N f iesemba ded DCM n union 1394 AV 
devices as part of the 1394 control module 120, Is capable of hosting Java DCMs 
communicated from the 1394 devices tnemselves, and is capable of executing 
Java Haviefs (retnevsPie voce the internet) that are associated with the DCMs of 
1394 devices. The DM 1 1.0 also preferably supports device embedded DCMs 
through the 1394 control module 120. Embedded DCMs are controllers for a 
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c'rficd t f CPU-sr. not Java.) A 1394 devi $a> 

conta^ embedded DCMs to support certain other devices, typically IRC devices 
that it expects to see. Since an IRC AV device does not present a DCM of Its 
own, some other device (a 1394 device) in the HTNS 10 must provide the DCM. 

Ph ihi DM \ 10 ah itrat : a Hi c th- H 'A f V : \\ > to dish t uie tne lead of 
DCMs to be hosted and, thus, the control of 1394 devices 40 within the HTNS 10, 
(0084] To communicate and control a Wide variety of IRC devices, the IRC module 
130 transforms the commands or instructions from the DMS 1 16 into device 

m vA,df~ N The IRC module 130 
maintains the SR code library or database 131 . The IRC module 130 also 
includes a translation layer (trarrscoder) 133 that converts the commands or 
instructions to the correct 1R code to he transmitted to the chosen externa; device 
138, Based on the Information from (R code library 131 , which includes the 
modulation parameters (carrier frequency, duty cycle), and some representation 
of the ons and offs that represent the command, and OCO/PMOs in the PC1 1 17, 
the correct IR code for the device 136 In focus is synthesized. The transeoder 
133 or communicate n hatv let insn makes up a message or packet containing 
the IR code. The packet is then sent to a blaster micro controller 134 over a 
serial link via a blaster driver 132, The blaster controller 134 then transmits the 
packet or message via an IR blaster 135 to the external devices 136. The IR 
blaster 1 35 is preferably an IR emitter or repeater. The blaster controller 1 34 
preferat \ nds messa nai tan x requ red by the tev as » 1 c ted m. 
the DCQ/DMO of the device For example, soma devices may expect two 

s of the same messag f c 1 1 31 

may send the same command several times in succession if needed. 
J0085J The TV control module 140 operates ail of the TV hardware, i.e., the 
internai input devices 148. such as, for example, a digital inner 142, a mpeg 
decoder 144, and an AC-3 decoder 146 and the like. The TVCM 140 manages 
the staie of the signals on the screen, including which signal appears in the main 
and sub pictures and answers questions from the DMS 118 about what 
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yjom c \ os< a, e.g., wl «ces arc IP vldec 

i s e TVCM 14C and s * * 3 is nsj syed on the TV screen and 

\ nds hs nc en«x 
controlling blPE < « f , o proces ing N1 C video pi » nq mc ip 
synch between audio and video decoders. Like the iRC and 1394 control 
modules 120 and 130, the TVCM 140 transforms the command or instructions 
from the QMS 1 18 into device appropriate messages to communicate with the 
internal input devices 148 of the HTNS 10. 

ft)tS6| The DM 1 10 of the present invertv 1 , ^ < s > u - „ o 
-,m i,\^i, , 4 - » j < , provides high c< ; ■nutation 

sensitivity within the DM 110. With the configuration setup subsystem, users are 
able to setup the connection configuration of the HTNS 10 in a first time out of the 
box iniisa! setup mode. In an edit mode, the setup subsystem enables the user to 
change, modify (i.e., customize) or delete existing configurations. In the initial 
setup mode, too user is provided with a pre-set configuration of IRC device input 
connections on the DTV 12 and instructed to connect the IRC devices 140 to the 
DTV 12 accordingly. 

{WW} in order to build the DOW 11? and DSL 118, and the DCO/DMOs and DJOs 
corresponding to the IRC devices 40 of the HTNS 10, a "device" menu 200 (see 
Figs. 7 A and 78} is presented. The user fills out the device menu 200 to log in 
each IRC device corresponding to the devices in the pre-set connection 
<-enf=quratk>n. The device menu 200 appears In the main video 13 on the screen 
1 1 of the DTV 12 and may be filled out, navigated and controlled using the keys 
on the remote 20. Preferably, the device menu 200 indicates at the top of the box 
200, where the word "device type" appears, which IRC device, i.e., VCR, DVD, 
b!e, and the like, the user is h« k r In p uti r, the us< s > 

e required the tur ne in f M i 1 ~ ! idow20 

and the model number in the "Model No," window 204 as shown in Fig. 7A. 
Preferably, however, the user may he required to select a manufacturer from a 
pull down manufacturer menu window 208. When the user selects a 
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manufacturer. the con o! sys em t sent a mes e contro system 

is optimized for a manufact od s d iws n Fig r*B 

The device type, the manufacture's name and the modes number are then used 
by the DMS to build the DCO/DMOs and OiO for the supported devices. 
1.00881 Once ait the IRC devices are logged in, a "review" menu 220 (see Fig, 8) is 
presented that enables the user to review the IRC devices 222 connected to the 
HTNS 10, their connections 223 to the DTV 12, and their connections 226 to an 
AV receiver, if sued a device is connected to the HTNS 10. Because the DM 110 
of the present invention incorporates the Device Discovery and Sehddentifkvmors 
processes defined In the HAVi and AV/C specification, the 1394 devices 224 
connected to the HTNS 10 wis! automatically appear as connected devices in the 
"review" window 220. in addition, if a new 1394 device is added, the DM 1 10 wiii 
automatically add it to the configuration. Lastly, the review menu 220 may be 
used to turn off or disable a particular input. 

|0089| To complete or edit the setup configuration, the user selects the "next" key 
n the re\ sv\ n enu > le ps s< nt a "finis* tenu ; 6 (see Fig. 9A) The user 

y complete in no the "finish" key or edit the 

configuration by selecting the "edit" key. if the user selects the "edit" key, an 
"edit" menu 228 is presented. The edit menu 228 (see Fig. 9B) preferably allows 
the user to add an IRC device to an unused input on the DTV 12, change the 
name or connections of an IRC device already connected, delete a device or the 
entire setup configuration, return to the review menu 220 and turn an input on or 
Off, or restart the initial setup subsystem if "add" or "change" are selected, an 
3d e \ 'X > v res * ^ r to select w? d 

device the user wishes to add or modify. Once the user chooses the device to 
add or modify, the device menu 200 (fig. 7A or 78) is presented to allow the user 
to change the device manufacturer. When complete, the user selects "next" and 
is presented with a "name" menu (not shown), which allows the user to change 
the name of the device to a user preferred name. When complete, the user 
selects "next" and is presented with a "connection" menu 230. (see Fig. 9C) The 



33 



W0 02/09.1 IS 4 



< < | , > 



n n * i «■ I ! ! ions c f an IRC 

evsce to t 1 d/c AV receive? Tc c a or custc size 

he conn e( i s I f * i n $2 to the DTV 

the user may Identify whether the input device's video and/or audio are connected 
to the TV by selecting the audio and video boxes 234 and 236, To add, modify, 
change or customize the connections of the device identified in the AYR input 

< * I - < ^ i k n < 5 vsdoo 

ami/or audio are connected to the AVR by selecting the audio and video boxes 
240 and 242, 

t se ,v sa i N v u o vnhi\ h, 1 s < * 

HTNS 10 and configure the hybrid 1394 device to operate as such within the Dfv! 
1 10. A hybrid 1 394 device is a device capable of receiving analog and digital 
input and o r r Vn n-« « <« 

100911 During setup (initial or edit), if "other" is selected for the manufacturer, an 
option to loam IR or other control codes of a device may be presented, A learning 
screen is presented that provides a list of buttons on a remote control device that 
can be supported and learned. After a button on the screen is activated {Py a 
pressing of enie f p ■ "* -> ' ' DVS 1 10 ^ m ie<srrng mooe 

im fit R cod* < ' - RC * t 5 vh h 1 esan belr g 

learned is then pointed at the DTV 12, and the designated key pressed to allow 
capture of the IR code. A change in the appearance of the soft key (e,g., an 
addition of a checkmark) indicates which keys have been successfully added to 
IR code library. The learned iR codes are added to a newly created DCO/DMO for 
the device being added. The DCO/DtdO behaves the same as those already in 

! i tegrated with th* Iread s | ported 

devce** and wl! show i s I - j < y I 

supposted devices Cunng - <> • .»*•.*• l on An entry in a learned devices 
- i se m be add 1 *eil a u stent storage 

00 z\ )eratio f Fig 2A-2D, 3A, and 4-6, the us 5 s > 

$ - 'on- k \ ice ke> 28 of the remote 20 to display the de - * self ' * on menu 
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52 while watching a movie being played on the D-VHS VCR 41 and displayed on 
th n \ creen 1 * 3! t D i 1 » i j 

the detector 103, decoded by the TV micro 105 and transmitted to the UiM 1 1 1 of 
the DM 1 10. The AVChl 112 determines the current system state and. based on 
such information, thai the event is a menu-related event. The AVCM 112 
transmits the event and the system state information to the GUIfvt 1 14. The GUIM 
1 14 determines, based on the current system state information, that the event is a 
menu display event and transmits a message to the JVCU 140 to display the 
device selection menu 52 in the main video 13 on the screen 11 of the OTV 12 
with the current system state Information and device options displayed 
IPf3J With the device selection menu 52 displayed, as shown in Fig. 2A, the 
visual recognition system of the Ui 50 provides the user with on-screen, real time 
visual recognition of the current system state, the current navigation within the 
device selection menu 52, and the devices connected to (i.e., device options 
within) the HTNS 10, Referring to the device window 60, the crossmatching in 
the D-VHS VCR c ndi hat the D-V'HS 11 1st nt input 

device. The bold outline about the D-VHS VCR icon 68 indicates that it is the 
currently selectee device icon for navigation within the device selection window 
60. The DBS tuner icon 61 is grayed out, which indicates that the DBS Tuner 32 
is disabled or unavailable possibly because the DBS Tuner 32 has been 
disconnected from the DTV 12, its power has been turned off, or the DM 110 
does not snow what the tuner is connected to because the video checkbox for the 
TV may have been unchecked in the connection screen or a device is recording 
of? of the main T\ k < put No other icon high ii , s t the device 

window 00. which indicates that all other input devices corresponding to these 
icons are available for connection and operation. 

|00<>4) Referring to the video window 70 in Fig. 2A ; the cross-hatching in the TV 
v>deo icon 72 indicates the main video 13 of the DTV 12 is the sink or output 
device tor the video signal from the D-VHS VCR 41 . Turning to the audio window 
80, the AVR icon 84 is grayed out indicating that the AVR 37 is not available as 
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an aud\o sink for the audio signal from the D»VHS VCR 4 1 . The sack of 

ting sn th< > icon i 1 of the CT\ 12 

is not the current audio sink for the audio signal of the D-VHS VCR 41 and ii is 
not the current selected menu icon during. na\ igation within the audio window 80. 
The cross-hatching in the D-AVR icon 86 indicates that the D-AVR 44 is the 
current audio sink for the audio signals from the D-VHS VCR 41 , The bold outline 
about the D-AVR icon 86 indicates that the D-AVR 44 is the current selected 
audio output icon during navigation within the audio window 80, 
100951 The user U may then depress the left arrow of the adjust button 29 on the 
remote 20 to navigate within the device window 60 of the device selection menu 
52 to the adjacent icon 65 corresponding to a IRC AV device 35, As before, this 
event signal is received and amplified by the detector 103, decoded by the TV 
micro 106 and transmitted to the UIM 111 of the DM 110. The AVCM 112 
determines the current system state and, based on such information, that the 
event, is a menu-related event The AVCM 112 transmits the event and the 
system state information to the GUIM 1 14. The GUIM 114 determines, based on 
the current system state Information, that the event is a menu navigation event 
and transmits a message to the TVCM 146 to navigate to the next icon within the 
device window 60, transmits this Information to the AVCM 1 12 and queries the 
&VCr H2 M)t »i o <^ <>>»>%> Mi state 

Information to the TVCM 140 and instructs the TVCM 140 to display the current 
system state information and device options within the device selection menu 52. 
|00^| I the ae ic* >wr. in Fig. 28, the be lo outline about the 

IRC AV device icon 65 indicates that it is the currently selected device icon for 
navigation within the device window 80, while the cross hatching in the D-VHS 
VCR icon 66 indicates that the D-VHS VCR 41 is still the current input device. In 
the v;deo window 70, the cross hatching >n the TV video icon 72 indicates that the 
main video 13 of the DTV 12 is still the video sink tor the video signal from the D~ 
VMS VCR 41. Because the IRC AV device 35 is actively connected in a recording 
peer-to-peer connection with the IRC VCR 33, the connection window 90 is 
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di : .piayed. In the connection window 90 the VCR icon 92 indicates that SRC AV 
device 35 is connected to the IRC VCR 33 In a recording or some other peeeto- 
peer connection, in the audio window 80, the hold outline about TV audio icon 82 

it is the curre acted ice \ within h 

window 80 and is available for an audio connection with the IRC AV device 38, 
The AVR icon 84, which is not bold outlined, indicates that the IRC AV receiver 37 
is available as an audio sink for the audio signal of the SRC AV device 35, but is 

* * - ted icon for navigation within the audio window 80. The O- 

AVR icon 88 includes cross hatching to indicate that it is wo current audio sink for 
the audio signal from the D-VHS VCR 41.. The D-AVR Icon 88 is also grayed out 
to indicate that the D-AV receiver 44 is unavailable as an audio Sink for the audio 
signai from the IRC AV device 36, 

[WS>1] The user U may again depress the left arrow of the adjust button 29 on the 
remote 20 to navigate within the device window 60 of the device selection menu 
52 to the adjacent DVD icon 64 corresponding to the IRC DVD player 34, Again, 
this event signal is received and amplified by the detector 103, decoded by the TV 
micro 105 and transmitted to the USM 111 of the DM 110. The AVCM 112 
determines the current system state arid, based on suds information, that the 
event te a menu-related event The , AVCM 1 12 transmits the event and the 
system state information to the GUM 114, The GUIM 114 determines, based on 
th< current sy-mm date information, that the event is a menu navigate event and 
transmits a message to the TVCfvi 140 to navigate to the next icon within the 
device window 80, transmits this information to the AVCM 112 and queries the 
AVC M 112 as ( 1 > 1 * * 

information to the TVCSvl 140 and Instructs the TVCM 140 to display the current 
system state Information and device options within the device selection menu 52. 
\mm) in the device window 60, as shown in Fig. 2C S the bold outline about the 
DVD icon 64 indicates that if is the currenHy selected device icon for navigation 
within the device selection window 60, white the cress hatching in the D-VHS 
VCR icon 66 indicates that the D-VHS VCR 41 is still the current input device. In 
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the video window 70, the cross hatching in the TV video icon 72 indicates that the 
as I <i I <• l s < > - 1 t 1 ! v v ? > 

VHS VCR 41. In the audio window 80. the bold outline about the AVR Icon 84 
indicates thai it is the currently selected device icon for navigation within the audio 
window and is available as an audio sink for the audio signal from the IRC DVD 
player 34. The TV audio icon 82, which is not bold outlined, indicates that the TV 
audio 15 of the DTV 12 is available for as an audio sink for the audio signal from 
the IRC DVD player 34, and that the TV audio Icon is not currently selected for 
navigation within the audi \ £ 8-0, The O-AVR icon 88 includes cross 
hatching to Indicate that it is the current audio sink lor the audio signal from the D- 
VHS VCR 41 . The D-AVR icon 88 is also grayed out to indicate that the D-AV 
receiver 44 is unavailable as an audio sink for the audio signal from the IRC DVD 
player 34 Alternatively, the D-.AVR soar; 86 may be grayed out with no cross- 
hatching when the device Is unavailable as an audio sink, 
|0099t Next, the user U may press the enter (or select) button 22 or some other 
appropriate key on the remote to select the current s 
devices i ' * * n seeded icon 

corresponded to a 1394 device, a pop-up menu (not shown) would be presented 
providing the user with sub-unit options to choose from. The adjust button could 
be used to navigate between the sub-unit choices and the enter (or select) key 
could be used to select the desired sub-unit. 

(9.1001 As before, this event signal Is received and amplified by the detector 103, 
decoded by the TV micro 105 and transmitted to the UIM 1 1 1 of the DM 110, The 
AVCM 1 12 determines the current system state and that the event is a menu 

a i v t nt and tm system state 

information to the SIMM 114, The GUIM 114 determines, based on the current 
system state Information, that the event is a menu device action and transmits a 
message or command to the DMS 1 18 containing the current system state 
information and instructing the D'MS 118 that the DVD player 34 has been 
o i< ted as the input device, that the TV video 13 of the DTV is the video output 
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device, and ( <\V receive? 3 " f% sudio output 

device. Based on the current system state Information and device command, the 
QMS 1 1 6 queries the DCL 1 1 ? sod OIL 118 for connection, I/O port, operation 
information and the iike contained in the DCQ/DMOs and DIOs, and then 
formulates en appropriate message, which it transmits to the TVCM 140 
instructing the TVCM 140 to have the TV micro 10S switch the video input port 
from the port for D-VHS VCR 41, i.e., the 1394 port, to the port to which the IRC 
DVD player 34 is connected. The DMS 116 also formulates an appropriate 
message that It transmits to the 1394 control module 120 instructing it to slop or 
shut down the D-VHS VCR 41 and D-AVR 44. The 1394 control module 120 calls 
up the appropriate DCMs 122, which translate the instructions into device specific 
messages that the 1394 driver transmits to the O-VHS VCR 41 and D-AVR 44 to 
stop or shut down the devices. The DMS 118 also formulates appropriate 
messages that it transmits to the IRC module 130 instructing it to operate the 
DVD 34 and the IRC AV receiver 3? and to perform the appropriate switching 
within the DVD and the AVR to enable an audio connection there between. The 
IRC module 130 accesses the !R code library 131 and formulates messages 
corresponding to the commands from the DMS 116 that contain device specific SR 
code for the chosen devices. The messages or packets are then transmitted 

tot si ter irolier 134 via the blaster driver 132 The I R blaster 
t controls the Par nis e $ I s to the DVD p * surf 

the AVR 3? via an IR Blaster 135 (emitter/repeater} and in accordance with the 
DCO/DfvtOs of the chosen devices. 

(0.101) At the same snie the DMS 116 is seamlessly handling the switching and 
connection of the devices, the GUIM 1 14 is instructing the TVCM 140 to bring up 
the transport menu 54. The transport menu 54 provides the user U with a familiar 
se! of control function buttons for operating external devices through the control 
system and inter acts with the i II 50 a^a DM 110 The transport menu 54 includes 
a list of six icons corresponding, to standard commands of "Rewind", "Pley*, 
Forward Stop Pause and "Record's The transport menu 54 typically may 
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also be displayed when an external devsce Is active and any of the keys 

i mte 20. As 

depicted m Fig 2D, buttons are grayed out thai correspond to functions the 
selected device is incapshle of performing, e.g., conventional DVD players can 
not record, therefore the record button Is shown grayed out, 
|0102] For IRC devices, the DM 110 preferably incorporates the display and 
operation of device specific control menus generated by the IRC device. The DM 
110 preferably maps the display of such menus to the "mem/ key on the remote. 
For 1394 devices, the DM 110 preferably in a /* > 
controllers for displaying OSD's horn external 1394 devices that provide them. 
The OSDs from these devices give access to unique features of those devices 
that, are not pad of the normal controls, For example, pressing the PLAY button 
will cause an AV/C Q-VCR to begin playing. But the user can stili access unusual 
features, such as a sophisticated "cueing by GOP" by accessing that AV/C 0- 
VCR's menus. The DM 110 preferably incorporates ways to include the Ul's of 
external devices as though they were extensions of its own. To do this, the PM. 
110 preferably incorporates AV/C Panel Controller functionality; HA VI DDI 
interface, and E1A-775A bitmap interface, a HA VI !eveh2 Ul (havlet), and the like. 
|0103| With the play button al the transport menu 54 highlighted, the user U may 
hit the enter tor select! key 22 or the play button en the remote 20 to begin 

win >VD /r % before, this event is re< r d amplified 
by the detector 103. decoded by the TV micro 105. and then transmitted to the 
UIM 111 of the DM 11 0 The AVC.M 1 1 2 determines the current system state and 
that the event Is a menu related event The AVCM 112 transmits the event and 
the system state information to the GUIM 1 14. The GUIM 114 determines, based 
on the current system state Information, that the event is a menu device action 
and transmits a message or command to the OMS 116 containing the current 
system state information and instructing the CMS 1 16 to have the DVD player 34 
begin playing, Based on Hie current system state information and device 
command, "play", the DhlS 116 formulates an appropriate message that it 
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transmits to the IRC moduli 135 gin playing 

The IRC module 1 30 accesses the IR code library and formulates a message 
corresponding to the play command from the DMS 116 that contains device 
specific IR code. The message or packet is then transmitted serially to the IR 
blaster controller 134 via blaster driver 132. The IR blaster controller 134 controls 
the transmission of the packet to the DVD player 34 via the IR blaster 135. The 
DVD player 34 begins to play with its video outputted on the main picture 13 of 
the screen 1 1 of the DTV 12 and its audio outputted from the IRC AV receiver 37. 
While the DM 100 is performing all the noted operations, the GUIM 114 may 
Instruct the TVCM 1 40 to display a visual indicator that such activity is occurring. 
\mmi For PIP operation, the user U may depress the PIP device key 27 on the 
remote 20 to display the PIP device selection menu 152. which, as depicted in 
Fig. 2E, comprises device and video windows 180 and 170 that appear 
substantially the same as the device and video windows 60 and 70 of the device 
selection menu 52. The sud-picmre icon 172 corresponds to the PIP or sub 
picture 14 of the screen 1 1 of the DTV 12. The DM 110 acts to display the PIP 
device selection menu 152, and responds to navigation and device action 
commands in the same manner as discussed above in regard to the device 
selection menu 52. The GUIM 114, in coordination with the TVCM 140. indicates 
in the PIP de\ ce o nd >v, 160 wh ch ii p if dev res > > av I ;b r as a source 
device for the PIP video by graying out icons of those devices that are not 
available. For example, all icons corresponding to 1394 devices may he grayed 
out it the video signal to the main picture 13 is an analog signal, 
fonts i For recording or other peer-to-peer connection operation, the user 0 may 
press the RECORD and Connect buttons 25 and 23 on the remote 20. In 
response, she DPI 110 displays a Record/Connect menu 250 on the screen 11 of 
the DTV 12 wherein the currant device is the source device, (see Fig. 10} To 
record immediately, the user U selects a recording device in the device window 
252 and duration in the duration window 254, then presses the R.EC button 25 on 
the remote 20. To record at a later time, the user U also selects a starting time in 
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the start time window 256 and day in the set day window 268, and then selects 
the Add button in the dialogue window 250 to store the future recording in 
persistent storage. For recording output from antennas, cable boxes, satellite 
boxes, and other devices with channel selections, the user selects the channel for 
recording in the channel window 260. For recording output from 1394 devices, a 
pop-up menu (not shown) would be presented providing the user with sub-unit 
options to choose from The adjust button could he used to navigate between the 
sub-unit choices and the enter for select) key could be used to select the desired 
sub-unit. To see a list of future recordings, the user U may select the List Button 
in the dialogue window 250. To connect a source device to a sink device in a 
peerdo-peer connection, the user U selects a device in the device window 252 
and duration In the duration window 254, then presses the Connect button 25 on 
the remote 20. 

I.CKI06] The recording and other peer-to-peer connections may be over physical 
connections that include the OTV 12 or over physical connections, that do not 

> f has nph ^ 1 i of a > > D 

1394 device on an auxiliary 1334 video display device. As with other operations, 
the DM 110 receives the record or connect event signal end translates it to 
perform the necessary switching, make the necessary connections, and operate 
the chosen devices, ail transparently to the user U, 

J;0f(J?J The control system 101 of the present invention preferably synchronizes its 
blasting of IR messages to supported IRC devices with the messages coming 
from the remote 20, to blast during gaps between remote messages and thus 
avoid IR '1aevn:ngh as described in US Paten Application No 08/555,.263Ior 

Kr ^ : \ ' i :<n-' - ' 1 2 - which is 

incorporated by reheence. IR jamming occurs when an external device cannot 
decode the commands blasted to it because the remote 20 is transmitting at the 
same time. The software on the remote 20 is preferably adapted to leave gaps 

luring boh ti DO D t messages otm ices. The DM 110 

preferably coordinates its IR transmissions with these gaps. The blaster 135 
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preferably has a means for communicating its busy/completion status to the DM 

110:. 

After a user command from the IR remote 20 or the front panel 16 starts an 
operation, if preferred that operation may not be interrupted with another user 
command, with the exception of certain desirable cases. Also if preferred, user 
commands ignored because of any operation already in-progress may be 

d*> 1 rtik, . ! l " 

(93891 Optionally, as shown In Figs. 11a and 11b, ape, m and 

methods are provided to enable the pass-through IR control of non-supported IRC 
devices 418 In a network of consumer electronics systems or a HTNS 400, while 
avoiding jamming of IR signals. The HTNS 400 preferably comprises a translator 
subsystem 408, such as the DM of the present invention, and a IR signal blaster 
or repeater 412. In addition, the HTNS 400 includes a remote A 402for 
controlling supported IRC devices 414 and 416 within the HTNS 400, an IR 
detector 406 serially connected to the translator subsystem 408 and an IR 
transmitter 412 for transmitting IR signals to supported and non-supported IRC 
devices 414, 41b end 416 serially connected to the translator 408. The HTNS 
400 comprises another remote 8 404 for operation of non-supported IRC devices 
418, The second remote B 404 may alternatively be a second programmable 
layer on the supported device remote A 402. Because the translator subsystem 
408 preferably does not recognize signals transmitted from the non-supported 
device remote 8 404 or communicate such signals to the transmitter 41 2 for 
broadcast to the non-sappoded devices 418, a gate 410 is provided in the HTNS 
10, wh, ^ * v f i ! r\ thr onoft) ; fhe 

gate 410, however, is also serially connected fhe translator 408 over 
communication link 409, When the gate 410 Is open, signals from fhe non- 
supported device remote 8 404 are "passeddhrouoif to the transmitter 412 for 
broadcast to the non-supported devices 418. When the gate 410 is closed, 
Signals from either remote may not "pass-through" to the transmitter 412 and, 
thus, IR signal jamming at. the transmitter 412 may be avoided. Operation of fhe 
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gate 4 1 0 is controlled by the translator 408, which instructs the gate 410 to close 
once it begt^. acting on an !R event signal The translator 408 will not instruct the 
gate to open cntii it has <V ~ f u-> that the iR signai is unrecognizable, i.e., not 
from a supported remote, or .until after the transmitter 412 has completed 
broadcasting signals to the supported devices 4 14 and 416 The transmitter 412 
rabi as i pabiiity to Inform the t > f s to when 5 d is n< 

busy, 

[0110] Alternatively, a HUMS 420 may include a first detector 406 serially 
connected to the translator 408 and a second detector 405 serially connected to 
the gate 410. Preferably, the first detector 400 * > at all signals 

not originating from the supported device remote A 402. The second detector 
405, wh ch is prefc I I t sign; 

ting fn >m the non-supported device remote 8 404 and transmitting such 
signals to the gate 410 for pass-through to the transmitter 412., Operation of the 
gale 410 is controlled by the transistor 408 in substantially the same way as in the 
previous embodiment, 

[Oil J 1 Turning to Figs. 1 2 and 1 3, the IR pass through system for control of non- 
DM supported devices is shown incorporated into the HTNS 10 of the present 
invention. As depicted, a second Wideband detector 401 is provided to defect IR 
signals not originating from a HTNS remote 20 or originating from a control layer 
other than the TV layer 23 on the HTNS remote 20 of the present invention The 
defector 4t - ? y connected to a gate 410, which is senally connected to the 
IR blaster 135 of the present invention and to the IRC module 130. When the 
gate 410 is open, signals detected by the wideband detector 401 are "passed- 
through" to the IR blaster 135 for broadcast to the non- supported external devices 
136. When the gate 410 is closed, signals detected by the ^sdeband detector 
401 may not "pass-through" to the IR blaster 1 35 and, thus. IR jamming may be 
avoided. The gate 410 is controlled by the IRC module 130 which instructs the 
gate 410 to close once It begins acting on an IR event message received from the 
DM 8 116, The IRC module 130 will not instruct the gate 410 to open until after 
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the R b aster 1 35 has co lal dev ces 

138, The IR blaster 135 preferably has the capability to inform the IRC module 
130 as to when it is and is not busy 

101121 While the invention is susceptible to v< > moc >ns a iermtm 
forms, a specific example thereof has been shown in the drawings and is herein 
eschb? s detei should t I >d ow* - t the vention snot to 

be limited to the particular form disclosed, but to the contrary, the invention is to 
cover ail modifications, equivalents, and alternatives failing within the spirit of the 
disclosure. 
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What is clasmed: 

1. A netv 1 tern a mousing 

a plurality of devices including a mix of 1 394 digital and IR controlled (IRC) 
analog devices, and 

a command center having an input adapted to receive user input 
commands and outputs coupled to the plurality of devices, the command center 
translating user input commands to device appropriate output messages to drive 
the 1394 and IRC devices. 

2. The network of claim 1 wherein the command center comprises an 
audio-video (AV) system. 

3. The network of claim 2 wherein the AV system comprises a 
television. 

4. The network of claim 1 wherein the command center comprises a 
control unit and a primary display unit coupled to the control unit, 

5. The network of claim 4 wherein the control unit comprises a 
computer. 

* 8. The network ol claim 4 wherein the primary display unit composes a 
television. 

7. The network of claim 1 wherein the command center comprises a 
context sensitive control system translating user input commands to device 
appropriate output messages to drive the 1394 and IRC devices. 

8. The network of claim 7 wherein control system comprises 
a translation module translating user input commands, and 

first and se < > - « p o the it an *hon moduh th< first 

and second control modules converting translated user input commands into 
device appropriate output messages to dove the 1394 and IRC devices, 

9. The network of claim 8 further comprising a 1 394 driver module 
coupled to the first control module, the 1394 driver module adapted to 

ommunlc o cr data tpu essages to the 1 394 d< s 

10. The network of claim 9 further composing 
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an IR emitter controller coupled to the second control modulo, and 
an IR emitter coupled to the emitter controller. 

1 1 . The network of claim 8 wherein the command center comprises a 
primary display screen. 

1 2. The network of claim 1 1 wherein the control system comprises a 
graphical user interface (til) dispiayabke on the screen of the command center 
and coupled to the translation module of the control system. 

1 3. The network of claim 1 2 wherein the Ul includes a device selection 
menu comprising a plurality of icon corresponding to the plurality of devices. 

1 4. The network of claim 1 3 wherein the device selection mono 
comprises a device selection window, a video sink window, end an audio sink 
window. 

1 5. The network of claim 14 wherein the device selection menu further 
t 1 n Jo * 

10, The network of claim 1 3 wherein the Ul further comprises a visual 
< syst 

1 ?. The network of claim 16 wherein the visual recognition system 
composes three slates of visual i *. n. 

18. The network of claim 1 7 wherein the three states of visual 
recognition comprise a disabled state, a current device state, and a selected 
device state, 

19. The network of claim 18 wherein the visual t } M< system 
comprises five states of visual recognition. 

20. The network of claim 19 wherein the five states of visual recognition 
system comprise a disable state, a selected/current device state, a selected/not 
current de\ t< si do , sot seier ' e state, and a not 
selected/current device state 

1 etwo 8 wherein th i t n > ! ~ r t 

a f . s* tic V eti fit jther an inpu? 

command comprises a menu related action or a direct device action. 
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a second module coupled io the first module, the second module 
determining whether a menu related action is a menu display action, a menu 
a < met iev-s e action, and 

a third module coupled to too Mrs* and second modules, the third module 
determining what device connections to Osaka and instructing the first and second 
control modules as to what device actions to take. 

22. The network of claim 1 further comprising a user command input 
device operabiy coupled to tne command carrier input. 

23. The network ot claim 22 wherein the input device is b. remote 

24. 1 ho network ot s \ 
signals. 

25. The network of claim 1 fui I' r sing IR emitter cables coupling 
the IR cor > i 1 ec nter 

26 The netvvom oi < u- . f. hfio t*e 

1394 devices to the outputs of the command center, 

27. A home theater network system {HTNS) comprising 

a control unit having an Input to receive user input commands, 
a primary display unit coupled to the control unit, 
a plurality of audio and video (AV) devices coupled to outputs of the control 
unit, the plurality of AV devices comprising a mix of 1394 and IRC devices, 
a cor mo >s, ! 

commands to device appropriate output messages to drive the 1394 and IRC 
devices, 

28. The HTNS of claim 27 wherein the primary display and control unit 
comprises an AV system. 

29. The HTMS of claim 28 wherein the AV system comprises a 
television. 

30. The HTNS of claim 27 wherein the control unit comprises a 
computer. 
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3 1 The HTNS of claim 27 ' - s 

television. 

32. he I IS t i rein the ontro ^ >$ a iser 
Interface (IN) module translating user input commands. 

33. The HTNS of claim 32 wherein the control system further comprises 
IR and 1394 control modules coupled to the Ui module, the IR and 1394 control 
modules converting translated use? Input commands into device appropriate 
output messages to drive the 1394 and IRC devices. 

34. The HTNS of claim 33 wherein the control unit and primary display 
unit comprise a television and wherein the plurality of AV devices include interna! 
television AV devices, the control system further composes a television control 
module. 

35. The HTNS of claim 33 further comprising a 1 394 driver module 
coupled to the 1394 control module, the 1394 driver module adapted to 
communicate device appropriate output messages to the 1394 devices. 

36. The HTNS of claim 35 further comprising 

, R emitu c , ' V I < n Vol module, and 

an IR emitter coupled to the emitter controller, 

•37. The HTNS of claim 33 wherein the control system comprises a 
graphical user interface (GUI) displayable on a screen of the primary display unit 
and coupled to the Ui module, 

38. The HTNS of claim 37 wherein the GUI includes a device selection 
re compris i nUy o > i n > the plurality of AV de met - 

39. The HTNS of claim 3d wherein the device selection menu comprises 
a device selection window, a video sink window, and an audio sink window. 

40. The HTNS of claim 39 wherein the device selection menu further 
comprises a connection sink window. 

41 . The HTNS of claim 37 wherein the GUI further comprises a visual 
recognition system. 

42. The HTNS of claim 40 wherein the visual recognition system 
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comprises three states of visual recognition, 

43. The HTNS of claim 42 wherein the three states of visual recognition 
comprise a disabled state, a current device state, and a selected icon state, 

44. The HTNS of claim 41 wherein the visual recognition system 
co rspr ses in >? vt I re< egn t m s 

45. The HTNS of claim 44 wherein the five states of visual recognition 
system comprise a disable state, a selected scon/current cevjce state, a selected 
ieon/nct current device state, a net selectee icon/not current device slate, and a 
not selected icon/current device state. 

46. The HTNS of claim 33 wherein the Ul module comprises 

a first module determining a current system state and whether an Input 
command comprises a menu relates action or a o-reor oevsce action, 

a second module coupled to the first module, the second module 
determining whether a menu related action Is a menu display action, a menu 
navigate action or a menu device action, ana 

a third module coupled to the first and second modules, the third module 
determining what device connections to make and Instructing the IH and 1394 
control c uduim as t ) ^ hat a . ce actions t< t $ke 

47. The HTNS of claim 27 further comprising a user command input 
device operably coupled to the Input of the control unit. 

48. The HTNS of claim 4? wherein the input device is a remote control. 

49. The HTNS of claim 48 wherein the remote control emits IR signals . 

50. The HTNS of claim 48 wherein the remote control emits RF signals. 

51 . The HTNS of claim 27 wherein the input of the control unit is a USB 

port. 

52. The HTNS of claim 27 wherein the mpm of the control unit 
. o npi ses a * >ystem 

53. The HTNS of claim 27 wherein the input of the control unit 
prist li ot connection. 

54. The HTNS of claim 2? further comprising IR emitter cables coupling 
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the I RC devices to the outputs of the control unit. 

55. The HTNS of claim 54 further comprising 1394 cables coupling the 
1 394 devices to the outputs of the control unit, 

56. The HTNS of claim 29 wherein the plurality of AV devices includes 
internal television AV devices. 

57. The HTNS of claim 31 wherein the plurality of AV devices includes 
internal television AV devices, 

58. The HTNS of claim 27 further comprise non-AV 1 394 devices 
coupled to the outputs of the control unit, 

59. The HTNS of claim 57 wherein the non-AV 1 394 devices include 
home appliances and systems. 

60. A network system comprising 

a command center having an input adapted to receive user input 
commands, 

a plurality of devices in communication with the command center over a 
plurality of protocols, and 

a context sensitive control system associated with the command center 
and having a uniform user interface for control of the plurality of devices, the 
control system translating user input commands to device appropriate output 
messages to drive the plurality of devices. 

81 , The network of claim 80 wherein the command center comprises an 
audio-videc 5\ - em 

82, The network of claim 81 wherein the AV system comprises a 
television 

63. The network of claim 80 wherein the command center comprises a 
contro un $ primary displ i 1 to th - \ c 1 > s 

64. The network of claim 63 wherein the control unit comprises a 
computer, 

85, The network of claim 83 wherein the primary display unit comprises 
a television. 
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86 The network of claim 80 wherein the pH ^ ! - of 
mix of 1394 and IR controlled devices 

67. The network of claim 60 wherein the plurality of devices includes a 
mix of globally and locally controlled devices. 

88. The network of claim 80 wherein the plurality of devices includes a 
mix of high and low speed devices. 

89, The network of claim 80 wherein the plurality of devices includes a 
mix of AV and non-AV devices. 

70.. The network of claim 80 wherein the plurality of devices includes a 
mix of analog and digital devices. 

71 . The network of claim 60 wherein control system comprises 
a translation module translating user input commands, and 

first and second control modules coupled to the translation module, the first 
and second centre ing translated user input commands Into 

device appropriate output messages to drive the plurality of devices. 

72. Toe network of claim 71 wherein the command center comprises a 
primary display screen, 

73. Tee network of claim 72 wherein the user interface comprises a 

d si uses interface ! - as a* ie on the screen of the command center 
and coupled to the translation module of the control- system, 

74 . The network of claim 73 wherein the GUI includes a device selection 
menu comprising a plurality of icon corresponding to the plurality of devices. 

78, The network of claim 74 wherein the device selection menu 
comprises a device selection window, a first sink device window, and a second 
sink device window, 

76. The network of claim 75 wherein the device selection menu further 
comphses a connection sink window. 

ie network of < * ; * I lh< < npris i vieua 
recognition system. 

78. The network of claim 77 wherein the visual recognition system 
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comprises a plurality of visual recognition states. 

79. The network of claim 78 wherein the plurality of visual recognition 
states com ; < < I stale, a e\ « and a sele ed device 

c'l.i. Tne network ot claim 77 wnerem the plurality' of visual recognition 
states comprises five states of visual reeoonliion. 

81 . The network of claim 80 wherein the five states of visual recognition 
system comprise 'a disable state, a selected/current, device state, a seleefe&fdet 
current device state, a not selected/not current device state,, and a not 
selected/current device state. 

82.. The network of claim 71 wherein the translation module comprises 

a first module P 1 1 * a current system state and whether an input 
command composes a menu related action or a direct device action, 

a second module coupled to the first module, the second module 
determining whether a menu reiafed action js a menu display action, a mens 
avigate action or <- f > e act 

a third module coupled to the first and second modules, the third module 
determining what device connections to make and Instructing the first and second 
control modules as to what device actions to take. 

.83, The network of claim 60 further comprising a user command input 
device ot dpy « o xpk d to the command center input, 

84. The network of claim 83 wherein the input device is a remote 
control. 

85. The network of claim 84 wherein the remote control emits IR 
signals. 

Sc. A network system composcm 

a control unit having an input to receive user input commands and outputs, 

a primacy display unit coupled to the control unit 

a plurality of devices coupled to the outputs of the control unit, 

a coi text sens! Ive > itro syster i % metre < n the cc t d hav ng 
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a uniform user interface to control the plurality of devices, the control system 
translating user input commands to device appropriate output messages to drive 
the plurality of devices. 

87. 7 he network of ciasm 88 wheresn the onmary display unit and control 
unit comprises an AY system. 

88. The network of claim 87 wherein the AV system comprises a 
television. 

89 The network of ciaim 85 wherein the control unit comprises a 
compulse 

90, The network of claim 86 wherein the primary display unit comprises 
a television, 

91 , The network of claim 86 wherein the control system comprises a 
user interlace dJh module translating user input commands. 

92. The network of claim 91 wherein the control system further 
comprises device control modules coupled to the Ul module and converting 
translated user input commands into device appropriate output messages to drive 
the plurality of devices, 

93. The network of claim 92 wherein the control unit and primary display 
unit comprise a television one wherein the plurality ot devices include internal 

tel v c 'W i television contro 

module. 

94, The network of claim 92 wherein the user interface comprises a 
graphical user interface (GUI) dispiayahle on a screen of the primary display unit 
and coupled to the Ul module, 

95. The network of claim W wherein the GUI includes a device selection 
f npdsing a p y of icon resf sg to the pi sty of devi 

98, The network of claim 96 wherein the device selection menu 
comprises a device selection window, a erst sink device window, ana a second 
ssnk device winnow. 

97. The network of claim 98 wherein the device selection menu further 
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comprises a connection sink window. 

98. The network of claim 94 wherein the GUi further comprises a visual 
recognition system. 

99. The network of claim 98 wherein the visual recognition system 
comprises a plurality of visual recognition states. 

100. The network of claim 99 wherein the plurality of visual recognition 
st, c^vcj < x n current device state, and a selected icon 
state, ■ 

1 01 . The network of claim 98 wherein the plurality of visual recognition 
states comprises five states of visual recognition, 

1 92, The network of claim 101 wherein the five states of visual 
recognition system comprise a disable state, a selected icon/current device state, 
a selected icon/not current device state, a not selected icon/not current device 
state, and a not selected IccWeurrent device state, 

103, The network of claim 02 wherein the Ul module comprises 

f first mod * I » 1 t i ip 

command comprises a menu related action or a direct device action, 

a second modoie coupled to the first module, the second module 
determining whether a menu related action is a menu display action, a menu 
navigate action or a menu device action, and 

a third module coupled to the first and second modules, the third module 
determining what device connections to make and instructing the device control 
modules as to what device actions to take. 

104, The network of claim 88 wherein the plurality of devices includes a 
mix of 1394 and IR controlled devices. 

105, The network of claim 86 wherein the plurality of devices includes a 
mix of globally and locally controlled devices. 

106, The network of claim 86 wherein the plurality of devices includes a 

mix Of >g >N x OA SS i s s < v "C^ 

107, The network of claim 86 wherein the plurality of devices includes a 
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mix of AV and non-AV devices. 

108. The network of claim S6 wherein the plurality of devices includes a 
mix of analog and digital devices. 

109. The network of claim 88 further comprising a user command input 
device operahiy coupled to the input of the control unit. 

1 1 0. The network of claim 1 09 wherein the input device is a remote 
control. 

1 1 1 The network of claim 1 10 wherein the remote control emits IR 
signals, 

1 1 2. The network of claim 1 10 wherein the remote control emits RF 
signals. 

1 1 3- The network of claim 86 wherein the Input of the control unit is a 
USB port, 

114, The network of claim 86 wherein thelrtput of the control unit 
comprises a voice recognition system. 

115. The network of claim 86 wherein the Input of the control unit 
comprises an Internet connection. 

i ,0. m television oompnyno 

a display screen, 

a circuit coupled to the screen, 

an input coupled to the circuit and &&apte<i to receive user input 
commands. 

outputs coupled to the circuit, and; 

a control system operating on the circuit, and translating user input 
commands to device appropriate messages to drive 1394 and IR controlled 
peripheral devices., 

1 1 7. The television of claim 1 16 wherein the television is a digital 
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television, 

1 1 8. The television of claim 1 1 8 further comprising a down converter 
adapted to convert digital source signals to analog signals. 

1 19, The television of claim i 1 6 further comprising a plurality of internal 
audio/video (AV) devices coupled to the control system. 

1 £0, The television of claim 1 1 9 wherein the plurality of internal AV 
devices includes a source signal tuner, 

121. The television of claim 1 16 wherein the control system comprises a 
user interface (Id) module translating user input commands. 

1 22. The television of claim 121 wherein the control system further 
comprises IR and 1394 control modules coupled to the Ul module, the IR and 
1 304 control modules converting translated user input commands into device 
appropriate output messages to drive the 1394 and IRC. devices, 

1 23. The television of claim 121 wherein the control system further 
comprises IR 1394 and television control modules coupled to the Ul module 
con ? g Mared user input co nm mds info < i > * t > < s< « ;g« 
drive IR controlled, 1394, internal television AV devices. 

124. The television of claim 122 further comprising a 1 394 driver module 
coupled to the 1394 control module, the 1394 driver module adapted to 
communicate device appropriate output messages to externa! 1394 devices 
through the television outputs. 

1 25. The television of claim 124 further comprising 

an IR emitter controller coupled to the IR control module, and 
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an IR emitter coupled to the emitter controller. 

128. The television of claim 1 21 wherein the control system comprises a 
graphical user interface (GUI) dispiayabie on the screen and coupled to the Ul 
module, 

127. The television of claim 128 wherein the GUI includes a device 
selection menu comprising a plurality ot scons corresponding to the plurality 
internal AV devices and external 1394 and IR controlled devices when such 
devices are coupled to the television outputs, 

1 28. The television of claim 12? wherein the device selection menu 
comprises a device selection window, e video sink window, end an nemo sink 
window. 

1 29. The television of claim 128 wherein the device selection menu 
further comprises a connection sink window.. 

1 30. The television of claim 127 wherein the GUI further comprises a 
visual recog *itic n s j>'st« n 

1 31 . The television of claim 1 30 wherein the visual recognition system 
comprises three slates of visual recognition. 

1 32 . The television of claim 1 31 wherein the three states of visual 
recognition comprise a disabled stem, a current device state, and a selected icon 

1 33. The television of claim 1 32 wherein the visual recognition system 
comprises five states of visual recognition. 

1 34. The television of claim 1 33 wherein the five states of visual 
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recognition system comprise a disable state, a selected icon/current device state, 
a selected icon/not current device state, a not selected icon/not current device 
state, and a not selected -con/correct device state. 

1 35. The television of claim 1 22 wherein the Ui module comprises 

a first module determining a current system state and whether an Input 
command comprises a menu related action or a direct device action, 

a second module coupled to the first moouie, the second module 
determining whether a menu related action Is a menu display action., a menu 
navsgste action or a menu device action, and 

a third module coupled to the first and second modules, the third module 
octormissng what device connections to make ano instructing toe IR and 1394 
control modules as to what device actions to take, 

136. The television of claim 1 18 further comprising a user command input 
device operabfy coupled to the input 

1 37. The television of claim 136 wherein the input device is a remote 
control. 

1 38. The television of claim 137 wherein the remote control emits IR 
signals. 

139. The television of claim 138 further comprising m !R signal detector 
coupled to the circuit. 

140. The television of claim 139 further comprising a television control 
ctf'cust board coupled to too IR Signal detector and the circuit board. 

141. The television of claim 1 39 further comprising an amplifier coupled 
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to the IR signal detector. 

1 42. The television of claim 1 37 wherein the remote control emits RF 
signals. 

143. The television of claim 116 wherein the input is a USB port.. 

1 44. The television of eiaim 1 1 0 wherein the input comprises a voice 
recognition system. 

1 45. The television of claim i 1 6 wherein the input comprises an Internet 
connection. 

146. A controller for a network system comprising a mix of 1 394 and IR 
controlled (IRC) devices, comprising 

an input command receiver, 
a plurality of outputs, and 

a control module coupled to the input command receiver and the plurality 
of outputs and adapted to translate user Input commands to device appropriate 
output messages to drive 1394 and IRC devices and transmit the output 
messages to 1394 and IRC devices when coupled to the plurality of outputs. 

147. The controller of claim 146 further comprising a primary display unit 

148. I ho controller of claim 14 7 wnerein the primary display unit 
comprises a television. 

1 49. The controller of claim 146 further comprising a down converter 
adapted to convert digital source signals to analog signals. 

1 SO. The controller of claim 148 wherein the television Is a digital 
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television. 

1 51 , The controller of claim 1 47 wherein the primary display unit 
comprises a slave monitor, 

1 52.. The controller of claim 1 46 wherein the control module comprises a 
user interface (U?) module translating user input commands. 

1 53. The controller of claim 1 52 wherein the control modulo further 
comprises a plurality of input device controllers coupled to the Ui module and 
adapted to convert translated user Input commands into device appropriate output 
messages to drive the 1394 and SRC devices and transmit the output messages 
to 1394 and IRC devices. 

1 54 . The controller of claim 1 53 wherein the plurality of input device 

! 1 t { < £ ! * \ U1 ' r ! - n and adapted to 

convert translated user Input commands into device appropriate messages to 
drive internal audio/video (AV) television devices. 

1 55. The controller of claim 1 S3 further comprising a 1 394 driver module 
coupled to one of the plurality of input device controllers and adapted to 
communicate device appropriate output messages to external 1394 devices. 

1 58. The controller of claim 1 55 further comprising 

an fR emitter controller coupled to one of the plurality of input device 

controllers, and 

an IR emitter coupied to the IR emitter controller, 

1 57. The controller of claim 1 46 whereto the controller comprises a 

graphical user Interface (GUI) coupled to the control module and displayahle on a 
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screen coupled to the controller. 

158, The controller of claim IS? wherein the GUI Includes e device 
selection menu comprising a plurality of Icons corresponding to 1394 and IRC 
devices when coupled to the controller. 

1 §9. The controller of claim 1 58 where in the device selection menu 
comprises a cevice selection window, a video ssnk window, and an audio sink 
m . , ■ 

1 60. The controller of claim 1 59 wherein the device selection menu 
further comprises a connection sink window. 

181 The controller of claim 1 5? wherein the GUI further comprises a 
visual recognition system. 

1 82. The controller of claim 160 wherein the visual recognition system 
comprises a plurality of visual recognition states. 

183. The controller of claim 161 wherein the plurality of visual recognition 
states comprise a disabled state, a current device state, and a selected icon 
state. 

164. The controller of claim 162 wherein the plurality of visual recognition 
states comprise a dssaPle state, a selected icon/current device stats : a selected 
icon/not current device state, a not selected icon/not current device state, and a 
not selected icon/current device state. 

185. The controller of claim 1 53 wherein the Ui module comprises 
a first module determining a current system state and whether an input 
snd com; ■ « - * 1 < ect de\ action 

m 



WO«2/*mi4 



a second module coupled to the first module, the second module 
determining whether a menu f elated action is a menu display action, a menu 
navigate action or a menu device action, and 

a third module coupled to the first and second modules, the third module 
i rminin s < * is to mane and instructing the plurality of input 

device controllers as to what device aci-ons 10 take, 

"06 1 i user command \npui 

device operabiy coupled to the Input receiver, 

1 87, The controller of claim 1 66 wherein the Input device is a remote 
control. 

168, The controller of claim 16? wherein the remote control emits IR 
signals, 

1 89. The controller of claim 1 68 wherein the input receiver comprises an 
IR signal detector coupled to the control module, 

170. The controller of claim 146 further comprising 3 decoder coupled to 
input command receiver and the control module. 

1 71 . Trie controller of claim 168 further comprising an amplifier coupled 
to the IR signal defector. 

1 72 . The controller of claim 1 6? wherein the remote control emits RF 
signals. 

1 73. The controller of claim 146 wherein the Input receiver includes a 
USB port. 

1 74. The controller of ciatro 146 wherein the input receiver includes a 
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v'uii.e ;eeogmtion syrens. 

1 75. The controller of claim 1 46 wherein the input receiver includes en 
internet connection, 

1 78. An audio-video (AV) system comprising 

a display screen, 

a circuit coupled to the screen, 

an input coupled to the circuit and adapted to receive user input 
commands, 

outputs coupled to the circuit, and 

a context sensitive centres system operating on the Circuit, the control 
system havm < mi use? 3 > ! 3 > » , t commands tc 

device appropriate messages to drive peripheral devices. 

1 77. The AV system of claim 176 wherein the AV system k a digital 
television. 

1 78. The AV system of claim 1 76 further composing a down converter 
adoptee to convert digital source signals to analog signals. 

1 79. The AV system of claim 1 78 further comprising a plurality of internal 
audio/video (AV) devices coupled to the control system. 

1 80. The AV system of claim 179 wherein the plurality of internal AV 
devices comprises a source signal tuner. 

1 31 . The AV system of claim 1 76 whem>n the control system comprises a 
user interface (Ui) module translating user input commands. 

1 82. The AV system of claim 1 8 1 wherein the control system further 
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c Oi n pi tses f s ret and second < ed to the Ul 

module, the first and second control modules converting translated user Input 
commands into device appropriate output messages to drive the peripheral 
devices. 

1 83, The AV system of claim 1 82 wherein the control system further 
coroonses terna device contfcl module < mvortinq * luce? npui 
commends into device appropriate messages to dove interna! AV devices. 

1 84. The AV system of claim 1 81 wherein the user Interface composes a 
graphical user interface (GUI) dispisyable on the screen and coupled to the Ul 
module. 

i 85. The AV system of claim 1 84 wherein the GU I includes a device 
selection menu comprising a plurality of Icons corresponding to the plurality of 
internal peripheral devices to he controlled, 

bo ! he AV sys 1 >n menu 

comprises a device selection window, a video sink window, anc on audio sink 
window, 

1 87, The AV system of claim 1 86 wherein the device selection menu 
n ( conm tson sink w nd sv 
* of c aim 185 wi 

visual recognition system. 

1 89 The AV system of dasm 1 88 wherein the visual recognition system 
comprises a plurality of visual recognition states 

100. The AV system of claim 189 wherein the plurality of visual 
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recognition states comprise a disabled state, a current device state, and a 
selected icon state, 

1 91 . The AV system of claim 1 89 wherein the plurality of visual 
recognition slates compose a disable slate, a selected icon/current device state, a 
selected icon/not current device state, a not selected icon/not current device 
state, ano a not selected icofVcurrent device stale 

1 92. The AV system of claim 182 wherein the Ul module comprises 
a first module • mining a current system sial 

commend comprises a menu related action or a direct device action, 

a second module coupled to the first module, the second module 

oetemenmg wOetoer a menu * d action ;s a menu oeipiay action, a menu 

navigate action or a menu device action, and 

a third module coupled to the first and second modules, the third module 

determining what device connections to make and instructing too first ana second 

peripheral device control modules as to what device actions to fake, 

1 93. The AV system of claim 1 76 further comprising a user command 
input device operably coupled to the input. 

1 94. The AV system of claim 1S3 wherein the input device is a remote 
control. 

1 95. The AV system of claim 194 wherein the remote control emits IR 
signals. 

1 96. The AV system of claim 195 further comprising an IR signal detector 
coupled to the circuit board. 
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197. The AV system of claim 178 further composing a decoder coupled 
tothe input ami the circuit. 

"Ob fl i ol claim 194 wherein the remote control emits RP 

signals. 

1 99. The AV system of claim 1 76 wherein the input is a USB port. 

200. The AV system of claim 1 76 wherein the input comprises a voice 
recognition system. 

201 . The AV system of claim 176 wherein the input comprises an Internet 
connection. 

202. A controiler for a network of devices communicating with the 
controller over a variety of protocols, comprising 

aii Input command receiver* 
a plurality of outputs, and 

^ \ ^* v. i i 1 - ri > i ? 

c u* i if -i * i «.c"*v 1 ^ en and 

uniform user interface So control network devices, the control module translating 
user input commands to device appropriate output messages to drive the network 
devices. 

203. The controller of claim 202 further comprising a primary display unit 
, pted to th< N N < o - »d v 

204. The controller of claim 203 wherein the primary display unit 
comprises a m v ' 

20§, The controller of claim 202 further comprising a down converter 
6? 
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ted rt h N « s » 

206. T he controller of claim 204 wherein the television is a digital 
television. 

207. The controller of claim 203 wherein the primary display umi 
comprises a slave monitor. 

208. The controller of claim 202 wherein the control module comprises a 
user interface (U!) no, user input commands. 

209. The controller of claim 208 wherein the control module further 
comprises a plurality of network device controllers coupled to the Ul module and 
adapted to convert translated user input commands into device appropriate output 
messages to drive the network devices, 

210. The coot * I i the user interface comprises a 
graphical user interface (GUI) coupled to the control module and dispiayahle on a 
screen coupled to the centrelier. 

21 1 . The controller of claim 21 0 wherein the GUI includes a device 
o^'^i*' f i > m . ^ o <. " <-« ' » v ces fo f e 
controlled. 

21 2. The .controller of claim 21 1 wherein the device selection menu 
comprises a device selection window, e first sink device window, arid a second 
sink device window.. 

213. The controller of claim 212 wherein the device selection menu 
further comprises a connection sink window. 

214. The controller of claim 210 wherefn the GUI further comprises a 
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visual recognition system. 

215. The controller of claim 214 wherein the visual recognition system 
comprises a plurality of visual recognition states, 

216. The controller of claim 21 5 wherein the plurality of visual recognition 
states cemp se s die shied st so a curre n d >\ « state am a selected icon 
state. 

217. The controller of claim 21 5 wherein the plurality of visual recognition 
states compose a disable state, a selected icon/current device state, a selected 
icon/not current device state, a not selected icon/not current device state, and a 
not selected icon/current device state, 

218. The controller of claim 208 wherein the Ul module comprises 

a first module determining a current system state and whether an input 
command comprises a menu related action or a direct device action, 

a second module coupled to the first module, the second module 
determining whether a menu related action is a menu display action, a menu 
navigate action or a menu device action, and 

a third module coupled to the first and second modules, the third module 
determining what device connections to make and instructing network device 
control em as to what dex ti < k« 

219. The controller of claim 202 further composing a user command input 
device operably coupled to the input receiver. 

220. The controller of claim 219 wherein the input device is a remote 
control. 
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221 , The controller of claim 220 wherein the remote control emits IR 
signals. 

222, The controller of claim 221 wherein the Input receiver comprises an 
IR signal detector coupled to the control module. 

223, The controller of claim 202 further comprising a decoder coupled to 
the IR signal detector and the control module. 

224, The controller of claim 222 further comprising an amplifier coupled 
to the IR signal detector. 

225, The controller of claim 220 wherein the remote control emits RF 
signals. 

226, The controller of claim 202 wherein the input receiver includes a 
USB port. 

227, The controller of claim 202 wherein the input receiver includes a 
voice recognition system, 

228, The controller of claim 202 wherein the Input receiver includes an 
tie 11 n c 

22 < > N i r f 9 R tr led h< 1 

devices in a system comprising a mix of 1394 and IRC devices, comprising 

a user Interface (Ul) mod < i nnands to device 

control instructions, and 

a device control module converting device control inshucuons f do device 
appropriate messages to drive 1394 and IRC devices. 

230, The control system of claim 220 wherein Ul module comprises 
70 



a first module capable of determining a current system state and whether a 
user input command comprises a menu related action or a direct device action, 

a second module capable of determining whether the menu related actson 
is a menu employ action, a menu navigate action or a menu device action, and 

a third module capable of determining what device connections to make 
1 " > v f r ol instructions. 

231 . The control system of claim 230 wherein the second module 
includes a graphical user interface (GUI) display-able on a primary display screen 
coupled to the control system. 

232. The control system of claim 231 wherein the GUI includes a device 
selection menu comprising a plurality of Icons corresponding to 1394 and IR 
devices coupled to the control system. 

233. The control system of claim 232 wherein the device selection menu 

o a second: 

sink device window. 

234. The control system of claim 233 wherein the device selection menu 
further composes a connection sink window. 

235. The control system of claim 232 wherein the GUI further comprises 
a visual recognition system. 

236. The control system of claim 235 wherein the visual recognition 
system comprises a plurality of visual recognition states, 

237. The control system of claim 238 wherein the plurality of visual 
recognition states comprise a selected Icon state, a current device state, and a 

71 



W0 02/09.1 IS 4 



disabled device state. 

238. The centre! system of claim 23? including primary, secondary, and 
tertiary visual indicators corresponding to ih& plurality of visual recognition states, 

239. The control system of claim 236 wherein the plurality of visual 
recognition states comprise a disable device state, a selected icon/current device 
state, a selected icon/not current device state, a not selected scon/not current 
device state, and a not selected seen/current device state, 

240. The control system of claim 239 including primary, secondary, and 
tertiary visual Indicators which when combined or presented individually 
correspond to the plurality of visual recognition states. 

241 . The control system of claim 230 wherein the third module includes a 
database comprising a list of devices coupled to the control system. 

242.. The control system of claim 241 wherein the database includes a fist 
of device connections. 

243. The control system of claim 242 wherein the database includes 

a*- i >n the i«t of d* N to the 

control system and comprising device identification, device type, I/O capabilities 
and device control Information. 

244, The control system of claim 243 wherein the device objects further 
include device control module r' , 1 <n 

245 1 ? ire /stem of cla 244 wherein the database includes 
1 - ' h-u x t tevice obj« cts c - jach 1394 dev ce ob est 

248, The control system of claim 245 wherein the database includes 
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device interconnect objects corresponding to each connection port of each device 
listed in the list of devices coupled to the control system, 

247. The control system of claim 246 wherein the information stored in 
the device interconnect object includes a port number, content, direction, and 
type. 

248. A control module for a cert o! system z >4 ano IR 
controlled (IRC) devices in a system comprising a mix of 1394 and IRC devices, 
comprising 

a first module capable of determining a current system state and whether a 
user input command comprises a menu related action or a direct device action, 

a second module capable of determining whether the menu related action 
is a menu display action, a menu navigate action or a menu device action, and 

a third module capable of determining what device connections to make 
and co su \ -m-.h ; s nstruct m« 

249. The control module of claim 248 wherein the second module 
includes a graphical user jnter? tee ■ ;. w )\ ■ -issplayable on a display screen, 

250. The control module of claim 240 wherein the GUI Includes a device 
selection menu comprising a plurality of icons corresponding to 1394 and IRC 
devices when coupled to the control system 

251 . The control module of claim 250 wherein the device selection menu 
comprises a device selection window, a first sink device window, and a second 
sink device window, 

252. The control module of claim 251 wherein the device selection menu 
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253, The control module of ciaim 252 whemin the Oil! further comprises 
a visual recognition system, 

254, The control module of claim 253 wherein the visual recognition 
system comprises a plurality of visual recognition states. 

255, The control module of claim 254 wherein the plurality of visual 

" ' * i r - Mate, and a 

dsebied staie. 

258, The control module of claim 255 including primary, secondary, and 
ternary visual indicators corresponding to the plurality of visual recognition- states, 

257 The control module of claim 258 wtterein the plurality of visual 
j < rise a >ie state, a selected icon/current device state, a 

selected icon/not current device state, a not selected icon/not current device 

,* ! <. s (.or state. 

258. The control module of claim 25? including primary, secondary, and 
tertsary vjsusI indicators which when combines or presentee individually 
correspond to the plurality of visual recognition states. 

259. The control module of claim 248 wherein the third module includes a 
iat ^bae x $ v <. to troi rno« uN 

280, The control module of claim 259 wherein the database includes a 
hst of de* e conm rtions 

281. The control module of claim 260 wherein the database includes 
device objects corresponding to each device In the list of devices coupled to the 
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control module an :om i , ieviee I/O 

capabilities and device control information. 

282. The control module cf claim 261 wherein the database Includes 
1 394 sub-unit, device objects connected to each 1394 device object. 

263, The control module of claim 262 wherein the database includes 
device interconnect objects corresponding to each connection port of each device 
listed in the list of devices coupled to the control module, 

284. The control module of claim 263 wherein the information stored in 
the device interconnect object includes a port number, content, direction, and 
type. 

285. A control system for a network of devices, comprising 
a uniform user interface, 

i c neo j< n s \v ! i s i 1 f sterface and 

translating user input commands to device control instructions, and 

a device control module converting device control Instructions into device 
appropriate messages to drive devices to be controlled, 

266. The control system of claim 265 wherein the translation module 
comprises 

a first module capable of determining a current system state and whether a 
user input command comprises a menu related action or a direct device action, 

3 second module capable of determining whether the menu related action 
is a menu display action, a menu navigate action or a menu device action, and 

a third module capable of determining what device connections to make 
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and converting input commands to device control instructions. 

287. The control system of claim 286 wherein the user interface includes 
50 o-s ? spiay screen v*. hen 

coupled to the control system. 

268. The control system of claim 287 wherein the GUi includes a device 
selection menu comprising a ; ! < ot icons corresponding to the device to oe 

289. The control system ot claim 268 wherein the device selection menu 
comprises a device selection window, a first sink device window, and a second 
sink device window. 

270. The control system ot coorn 2o9 wnerein the device selection menu 
further comprises a connection sink window, 

271 . The control system of claim 270 wherein the GUI further comprises 
a visual recognition system. 

272. The control system of claim 271 wherein the visual recognition 
system comprises a plurality of visual recognition states. 

273. The control system of claim .272 wherein the plurality of visual 
recognition states comprise a selected icon state, a current device state, and a 
disabled slate. 

274. The control system of claim 273 Including primary, secondary, and 
tertiary visual indicators corresponding to the plurality of visual recognition states, 

275. The contmi system of claim 272 wherein the plurality of visual 
recognition states comprise a disable state, a selected icon/current device state, a 
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selected Icon/not current device state, a not selected icon/not current device 
slate, and a not selected icon/current device state. 

278, The control system of claim 27 S including primary, secondary, and 
tertiary visual indicators which when combined or presented Individually 
correspond to the plurality of visual recognition states, 

277. The control system of claim 266 wherein the third module includes a 
daiaosse cornpnsjng a hsl ot devices coupled to the control system, 

278. The control system of claim 277 wherein the database includes a list 
of device connections. 

279. The control system of claim 278 wherein the database include 
device objects corresponding to each device in the list of devices coupled to the 

f - n * ■, »- I e C ! ^ d>> 

and device control information. 

280. The control system of claim 279 wherein the device objects further 
ihcn;«« liyvuA-; uunuut moo use snuu sa^ny snrOi-.^taon. 

2B1 . The control system of claim 280 wherein the database includes 
ievke* « 1 { - responding to each connection port of each device 

listed in the 1 pied to the control system. 

e> ; t o j ! ides a port b« tent, direction, and 

type. 

283. A control module tor a control system controlling a network ot 
devices . comp nsi r -g 
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a first module ca P m state and v. ethc 

user input command comprises a menu related action or a direct device action, 

a second module capable of determining whether the menu related action 
is a menu display action, a menu navigate action or a menu device action, and 

a third rrjoduie capable of determining what device connections to make 
and convening mput commands to device control instructions. 

284 . tf' i 

includes a graphical user interface (GUI) display-able on a display screen. 

285, The control module of claim 284 wherein the GUI includes a device 
,vei«uijun ;n«nu <,..ompny.ng « p;^a..y -..>; !u;ib •-unei»po ! >u!ny to oovk-u* to oe 
controlled. 

268, The control module of claim 28S wherein the device selection menu 
comprises a device selection window, a first sink device window, and a second 
sink device window. 

287. The control module of claim 286 wherein the device selection menu 
further comprises a connection sink window. 

2.88 . The control module of claim 287 wherein the GUI further comprises 
a visual recognition system, 

280, The control modu e . * ° v - ' ■ 

system comprises a plurality of visual recognition states, 

290. The control module of claim 289 wherein the plurality of visual 

tes comprise a sole \ levies id a 

disabled state. 
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291 , The control module of claim 290 including primary, secondary, and 
tertiary visual indicators corresponding to the plurality o? visual recognition states. 

292, The control module of claim 289 wherein the plurality of visual 
recognition states comprise a disable state, a selected Icon/current device state, a 
selected icon/not current device state, a not selected soon/not current device 
state, erd a not selected icon/current device state 

293, The control module of claim 292 including primary, secondary, and 
tertiary visual Indicators which when combined or presented individually 

294, i he control module ot claim 2u3 wherein tae tncd module includes a 
dataease comprising a list of devices coupled to the control module 

295, The control module of claim 29-1 wherein the database includes a 
list ot device connections, 

298. Tbtr ^ ? 1 t i ^ i ^t-mneludes 

device objects corresponding to each device in the list of devices coupled to the 
control module and comprising device Identification, device type, device I/O 
capabilities and device control information 

297, The control module of claim 298 wherein the database includes 
device interconnect objects corresponding to eacn connection pod ot each dev-ce 
listed in the list of devices coupled to the control module. 

298, The control module of claim 297 wherein the Information stored in 
the device Interconnect object includes a port number, content, direction, and 
type. 
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299 A graphical user itc c« v ! ! itncsiilng 
1394 and IR controlled (IRC) devices in a system comprising a mix of 1394 and 
;RC devices, comprising 

a device selection menu dlsplayable on a screen and comprising a plurality 
of icons corresponding to 1394 and IRC devices to be controlled, and 
>i v ( i n ' ? > i iuraiity ot ico; $ 

300. The GUI*/ ' t - t i 

a device selection wsno*ow. a hrst ^ devrce window, and tirst s;nk oev;ce 
window. 

301 . The GUI of claim 300 wherein the device selection menu further 
emprises jnneci i ' . 

302. The GUI of claim 301 wherein the visual recognition system 
comprises a plurality of visual recognition states, 

303. The GUI of claim 302 wherein the plurality of visual recognition 
states comprise a selected icon state, a current ciavsce state, end a disahfed 
state. 

304. The GUI of claim 303 including primary, secondary, and tertiary 
visual indicators corresponding to the plurality of visual recognition states. 

305. The GUI of claim 302 wherein the plurality of visual recognition 
states c rcp a disable state a sc icon rent device state, i iecied 
icon/not current device stats, a not selected scon/not current device state, and a 
not selected icon/current device state. 

306. The GUI of claim 305 including primary, secondary, and tertiary 
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visual indicators which when combined or presented individually correspond to 
the plurality of visual recognition states. 

30?, A graphical user interface (GUI) for a control system controlling a 
network of devices, comprising 

a device, selection menu dispiayabie on a screen and comprising a plurality 
of icons < - , I \ - ' ces to be controlled, a no 

a visual on , - 1 ity of Icons 

308. The GUI of claim 307 wherein the device selection menu comprises 

309. The GUI of claim 308 wherein the device selection menu further 
compr sos a co %t 

310. The GUI of claim 309 wherein the visual recognition system 
composes a plurality of visual recognition states. 

31 1 . The GUI of claim $10 wherein the plurality of visual recognition 
states cc r ted scon state, a current device state, and a disabled 

31 2. The GUI of claim 31 1 including primary, secondary, and tertiary 
s festers co ling umM.yoi isu ! g fates 

313. The GUI of claim 312 wherein the plurality of visual recognition 
states comprise a disable state, a selected icon/current ccvice state, a selected 
\d f ^1 < -^tde.ico state a not - <. » . i ! ' - and a 
not selected icon/current device state. 

314. The GUI of claim 31 3 including primary, secondary, and tertiary 
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visual Indicators which when com! rmspond to 

the plurality of visual recognition states.. 

315. A method of controlling a network system comprising a mix of 1394 

and IR controlled CIRC) audio-video and other input devices, comprising the steps 

of 

receiving user input commands at a centra! control unit of a network 
system, wherein the network system comprises a mix of 1 394 and IRC input 
devices, and 

translating the user input commands to device appropriate output 
ages to drive the Input devices. 

31 8, The method of claim 31 5 further comprising the step of maintaining 
within memory in the central control unit a list of all input devices, ail input device 
connections, and a!! I/O pods within the network system. 

317, The method of claim 315 further comprising the step of transmitting 
the output messages to the input devices, 

31 8, The method of claim 31 5 wherein the receiving step further 
comprises the step of detecting Input command signals from a remote control 
device. 

319, TPs method of claim 318 further comprising the step of transmitting 
input command signals from a single control layer of the remote control device for 
control of a!! input devices, 

g^. T n ? v i * vvherem t spot 

signals step further compt soa the steps of t? i for a II 
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device from a first control layer of the remote control device, and transmitting 
input commands for 3 second device Without switching to a second control layer 
of the remote control device, wherein the first device is an IRC or 1384 input 
device end the second device Is an IRC 1394 input device. 

321 . The method of claim 31 6 further comprising the step of inputting 
commands from an input device, whweui identical input commands are used to 
drive both 1384 and IRC input devices, 

322. The method of claim 315 wherein the step of translating further 
comprises the step of transforming user input commands for IRC devices Into 
dev-ce appropriate messages comprising device specific IR code. 

323. The method of claim 322 further comprising the step of transforming 
user input commands for 1394 devices into device appropriate messages 
formulated by device control modules corresponding to the 1384 devices. 

324. The method of claim 31 5 further comprising the step of directing a 
signal from a source input device to a sink device. 

325. The method of claim 324 further comprising the step of performing 
all necessary device connecting and input switching without further user input, 

328. The method of claim 31 S wherein the translating step further 
ce v 5 - ,f ■> t « 1 10 If the input command is a direct device action 
event or a menu related event 

327. The method of claim 326 further comprising the step of determining 
whether the Input command is a menu display event, a menu navigation event, or 
a menu device action event, 
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328. The method of claim 327 further comprising the step of displaying a 
device selection menu on a display screen coupled to the central control unit 

329. The method of claim 328 further comprising the step of visually 
indicating current system state. 

330. The method of claim 329 further comprising the step of visually 
indicating input source device options. 

331 . The method of claim 330 further comprising the step of visually 
indicating audio sink device options. 

332. The method of claim 331 further comprising the step of visually 

x \ r nk ee\ 

333. The method of claim 332 further comprising the stop of visually 

,e is the current input device and which devn - $ me current 

334. The method of claim 333 further comprising the step of visually 
indicating the existence ot a peer-to-pser connection. 

335. The method of claim 334 further comprising the step of visually 
I ci \ii \i i device >s unavailable as an Input device or audio sink. 

338.: The method of claim 335 further comprising the step of visually 
indicating navigation location within the device selection menu. 

337. The method of claim 328 further comprising the step of representing 
devices wtfhm 1 system as graphical icons displayed within the device selection 
menu. 

338. The method of claim 33? further comprising the step of displaying a 
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device selection window, a video selection window, and an audio sink window as 
prfftoi in s on menu 

339, The method of claim 338 further comprising the step of displaying a 
c o nn e ction window. 

340, The method of claim 337 further comprising the step of displaying a 

sink device, and menu location. 

341 , The method of claim 337 further comprising the step of displaying a 
puniu t tors providing vis ad device 
current source as ent source or sink 
device/current menu location, current source or sink device/not current menu 
location, and not current source or sink device/not cuxet^i menu location. 

342, A method of controlling a network of devices, comprising the steps 

of 

< un i of a 

network syste n x>mp Is ng a plurality of devices, 

<Atm w, ! u'0^\ \ |! r- > n network ,<s;ern ^nd 
based on stored device and device intef connectivity data, translating the 
user input commands to device appropriate output messages to drive the plurality 
of devices. 

343, The method of claim 342 further comprising the step of maintaining 
within memory *n me central control unit a list of all of the plurality of devices, ah 
device connections w-thio the network, system, one all I/O ports w>tnin me network 
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system 

344. The method of claim 342 further comprising the step of transmitting 
the output messages to the plurality of devices, 

345. The method of claim 342 wherein the receiving step further 
comprising the step of detecting input command signals from a remote control 
device. 

346. The method of claim 345 further comprising the step of transmitting 
input command signals from a single control layer of the remote control device for 
control of the plurality of devices. 

347. The method of claim 346 wherein the transmitting step further 
compnses the steps of transmitting input commands for a first device of the 
plurality of devices from a first control layer of the remote control device, and: 
transmitting input commands for a second device of the plurality of devices 
without switching to a second control layer of the remote control device. 

348. The method of claim 342 further comprising the step of inputting 
i k n xvmman s from an input devie< k the p sality of devices. 

349. The method of claim 342 further comprising the step of directing a 
signal from a source input device to a sink device. 

350 The moth*. * i 19 d cot rising th« '< , o ? > > rung 
all necessary device connecting and input switching without further user input 

351. The method of claim 342 wherein the tre ; tap further 
comprises the step of determining if the input command is a direct device action 
event or a menu related event. 
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352 fhe method of claim 351 
whether the input command is a menu display event, a menu navigation event, or 
a menu device action event 

353. The method of claim 352 further comprising the step of displaying a 
device selection menu on a display screen coupled to the centra! centre! unit. 

354. The method of claim 353 further comprising the step of visually 
indicating current system state. 

355. The method of claim 354 further mmm-v, - > - ! vlauaiiy 
indicating input source device options. 

358. The method of claim 355 further comprising the step of visually 
indicating sink device options. 

367. The method of claim 356 further comprising the step of visually 
indicating which device is the current sink device. 

358. The method of claim 357 further comprising the step of visually 
Indicating which device is the current source device. 

359. The method of claim 358 further comprising the step of visually 
indicating the existence of a peer-to-peer connection. 

360. The method of claim 355 further comprising the step of visually 
i ting a device is nn j s tree device or sink device 

5 61 !h- < c-mp of visually 

indicating navigation location within me device selection menu. 

362. The method of claim: 353 further comprising the step of representing 
de\ ess - > he system /ad within the device sele< < 
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many. 

363, The method of claim 362 further comprising the step of displaying a 
plurality of menu windows. 

364. The method of claim 332 further comprising the step of displaying a 
plurality of visual indicators corresponding to a disabled device : current source or 
sin < ^ d > ' n i 3ti lion 

385, The method of claim 382 further comprising the step of displaying a 
plurality of visual indicators providing visual recognition of a disabled device, 
current source or sink device/current menu location, not current source or sink 
u< N u a <l t e )Mu • m k< ^ i *s ^1 t it menu 

location, and not current source or sink device/not current menu location. 

188 \ method- of ' 1 1 fh;n a n«t\<\en> syste ? 

comprising a mix at 1 394 and IR controlled (IRC) audio-video (AV) input devices, 
comprising the steps of 

inputting an input command to display a device selection menu on a 
screen coupled to a central control unit of a network system , wherein the device 
selection menu includes screen representations corresponding to a plurality of 
input devices comprising a mix of 1394 and IRC AV devices within a network 
system, and 

selecting a screen representation of a first Input novice to select the input 
device as a source device, 

387. The method of claim 368 further comprising the step of selecting a 
funct on Dutton from a I Dontrai mi on the screen to drive the 
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source device according to the selected function, 

368. The method of claim 38§ furtlw comprising the step of navigating 
within the device selection menu to reach a screen representation of the ursi input 
device. 

389, The method of claim 366 further comprising the step of selecting a 
second input device as a new input source device Including the steps of 

inputting an input command to display the device selection menu on the 

selecting a screen representation of a second input device to select the 

370. The method of claim 369 further comprising the step of selecting a 
function button from the dsvfce con|«>i; menu displayed on the screen to drive the 
new sourc i > ii s€ ed function, 

371 . The method of claim 369 further comprising the step of navigating 

action menu to reach a screen f - 

Input device, 

372. A method of selecting a source device within a network system, 
composing toe sreps or 

inputting a command to display a device selection menu on a screen 
coupled to a central control unit of a network system, wherein the device selection 
menu Includes screen ret scnta > expending to a piu ility of input 
devices within the network system, and 

selecting a screen representation of a first input device to select the input 
89 



device as a source device. 

373. The method of claim 372 further comprising the step of selecting a 
function button from a device control menu displayed on the screen to drive the 
source device according to the selected function. 

374. The method of claim 372 further comprising the step of navigating 
wjihin the device setection menu to reach a screen representation or she tirst input 
device. 

376, The method of claim 373 further compnstng the step 4 * < 
second input device as a new input source device including the steps of 

inputting an Input command to display the device selection menu on the 
screen, and 

selecting a screen representation of a second input device to select the 
second Input device as a new source device. 

378, The method of claim 375 further comprising the step of selecting a 
function button from the device control menu displayed on the screen to drive the 
new source device according to the selected function, 

377, The method of claim 3? 5 further comprising the step of navigating 
within the device selection menu to reach a screen representation of the second 
input device. 

378, A method of selecting and controlling a sour ce device within a 
nam, ; ■= i- s> stem cos uprising the steps of 

inputting a first command through a uniform user interface to a context 
sensitive control system to select a source device, and 
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inputting a second command through the uniform user interface to the 
oonaoj syjrtwm 10 unvs *Ousoe Q^Vice. 

379. The method of claim 378 further comprising the step of selecting a 
second input device as a new source device including the steps of 

Inputting a third command through user interface to select a new source 
device; and 

inputting a fourth command through the user interface to drive the new 
source device. 

380, A method of controlling a network system, comprising the steps of 
creating a device list comprising a list of ail input devices coupled to a 

central control unit of 9 network system including a plurality of input devices, a 
connection port list composing a list oi ail connection ports within the network 
system, and a device connection list comprisina a list of all connections between 
input devices and the contml unit within the network system, and 

i< I fs n 

memory within the central control unit. 

381 - The method of claim 380 wherein the control unit Is an AV system. 

382. The method of claim 381 wherein the AV system is a television. 

383. The method of claim 382 wherein the television is a digital 

384. The method of claim 380 further comprising the step of creating a 
device adject tor each device in the device list. 

385. The method of claim 384 further comprising the step of storing the 
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device abject in 8 devsce object list, 

388. The method of claim 384 wherein the device objects includes device 

J *-\*v*C*\^.-x -4^.. ,;,->.-^ v >s .-v S *n -\,*. ~>K>!^:^ ~ ... 

i n ! uevf^w typ« t uevsorf t/O «nc oevive u>niros <N i 

387, The method of claim 38$ wherein the control unit includes e device 
control module, the device objects further include device control module 

388. The method of claim 385 wherein the step oi creating a device 
object for each device in the device list further comprises the step of creating unit 
level device objects to represent a device as a whole and sub-unit level device 
objects to represent sub-units of a device. 

369 ! he me I > 
the sub-unit level device objects to the corresponding unit level device objects, 

390. The method of claim 384 wherein the step of creating a device 
object comprising the step of discovering a device coupled to the control unit ami 
creating a device object 

391 . The method of claim 388 wherein the step of creating unit and sub- 
level device objects comprises the steps of discovering a device coupled to the 
control unit and scanning the device object list for a unit level device object for the 
discoverec device 

392. The method of claim 391 further comprising the step of creating unit 
and sub-unit level device objects for the discover:; device when no unit level 
device object is present in the device object list. 

393. The method of claim 391 further comprising the step of creating sub- 
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unit k fevice jecis for t 

device object present in the device object list. 

394. The method of claim 384 further comprising the step of creating a 
device interconnect object for each connection port in the connection port list. 

395, The method of claim 394 further comprising the step of storing the 
device interconnect objects in a device interconnect list. 

398. The method of claim 395 wherein the information stored in the 
device interconnect object includes a port number, content, direction, and type. 
39?. The method of claim 398 further comprising the steps of 
receiving uniform user input commands at the central control unit, 
determining current system state of the network system, and 
based on stored device and device interoonnectivlty data, translating the 
user input commands to device appropriate output messages to drive the plurality 
of input devices. 

398. The method of claim 397 further comprising the step of transmitting 
the output messages to the plurality of input devices. 

399. The method of claim 397 wherein the receiving step further 
composing the step of detecting input command signals from a remote control 
device. 

i of : ansmsttmy 

input command signals from a single centre; layer of the remote control device for 
control Of the plurality of mput devices, 

491. The method of cial > tot < ni dec further 
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comprises the steps of transmitting input commands for a first device of the 
plurality of input devices from a first control layer of the remote control device, and 
transmitting input commence for a second device of the plurality of input devices 
without switching to a second control layer of the remote control device. 

402. The method of claim 39? further comprising the step of inputting 
uniform commands from an Input device for the plurality of Input devices, 

403. The method of claim 397 further comprising the step of directing a 
signal from a soume input device to a sink device. 

404, The method of claim 403 further comprising the step of performing 
all necessary device connecting and input switching without further user input. 

405, The method of claim 403 wherein the translating step further 
comprises the step of determining If the input command Is a direct device action 
event or a menu related event. 

406, The method of claim 405 further comprising the step of determining 
whether the input command is a menu display event, a menu navigation event or 
a menu device action event. 

407. The method of claim 406 further comprising the step of displaying a 
ce select in? eon pled to the central control unit 

,e > \ s * « k v m 597 further comprising the steps of 
nputtin mend y z rsenu on a screen 

coupled to the central control unit, wherein the device selection menu Includes 
screen representations corresponding to a plurality of input devices, and 

selecting a screen representation of a host input device to select the input 
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device as a source device 

409. The- method of claim 408 further comprising the step of selecting a 
function button h a device control menu displayed on the screen to drive the 
source device according to the selected function. 

410. The method of claim 408 further comprising the step of navigating 

v's * too device selection menu to reach a screen representation ot the first input; 
device. 

411 . The method of claim 409 further comprising the step of selecting a 
second input device as a new input source device Including the steps of 

inputting an input command to display the cev;ce selection menu on the 
screen, and 

se e< ting as i ' ) select the 

second input device as a new source device. 

412. The method of claim 41 1 further comprising the step of selecting a 
function button from tea device control menu displayed on the screen to drive the 
new source device according to the selected function, 

41 3. The method of claim 41 1 further comprising the step of navigating 
within the device selection menu to reach a screen representation of the second 
Input device, 

414. The method of claim 380 wherein the plurality of input devices 
comprise a mix of 1394 and iR controlled a«dlo video devices. 

41 5. An audio-video (M) system comprising 
a display screen, 
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a context sensitive controller coupled to the screen and translating user 
input commands to device appropriate messages to drive peripheral devices, 

an IR signal receiver coupled So the controller and adapted to receive «$ef 
input commands. 

an IR emitter coupled to the controller, and 

s gate coupled to the emitter, the control!* » and the IR signal receiver. 
41 6, The AV system of claim 415 wherein the AV system Is a digitei 
television, 

41?. The AV system of claim 415 further comprising a down converter 
i : gifal source signals to analog signals 

418, The AV system of claim 41 5 further comprising a plurality of Internal 
audio/video (AV) devices coupled to the controller. 

419, The AV system of claim 415 wherein the IR receiver comprises fust 
and second IR detectors, the first detector coupled to the controller, the second 
detector coupled to the gate. 

420, The AV system of claim 41 5 wherein the IR emitter comprises first 
and second IR repealers, -he first repeater coupled to the controller, the second 

421 , The AV system of claim 415 wherein the controller comprises a user 
interface (US) module translating user input commands. 

422, The AV system of claim 421 wherein the controller further comprises 
first and second peripheral device control modules coupled to the til module, the 
first and second control modules converting translated user input commands into 
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^\ ce apprapj c te 01 put rnessag f ex ces 

423. The AV system of claim 422 wherein the first control module 
communicates output messages to drive iR controlled (iRC) peripheral devices to 
the iR emitter for transmission to the IRC devices. 

424. The AV system of claim 423 wherein the first control module Is 
adapted to close the gate until transmission of output message to the IRC device 
is complete. 

425. The AV system of claim 423 wherein the control system further 
comprises an internal device control module converting translated user input 
commands into device appropriate messages to drive Internal AV devices. 

426. The AV system of claim 423 wherein the Ul module comprises 

a erst .module determining a current system state and whether an input 
command comprises a menu related action or e dime! device action. 

a second moduie coupied to the met rnedsde. the second module 
determining whether a menu related action is a menu display action, a menu 
t or a menu device action, and 

a third moduie coupled to the first and second modules, the third module 
Owituuiiimiy vvna; oeviu« vOiismu.ionri io v.i&Ke <*no n i^hikAu-.g tee ft; una ^econo 
peripheral device control modules as to what device actions to take. 

427. A controller for a network of devices communicating with the 
oohtroiler over a variety of protocols, comprising 

an IR signal 

a IR transmitter, and 
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a control module coupled to the IR signal receiver and IR transmitter, the 
control module Including a context sensitive control system, the control module 
translating user input commands to device appropriate output messages to drive 
the network devices. 

426, The controller of claim 42? wherein the controller is a television.. 

429. The controller of claim 427 further comprising a down converter 
adapted to convert digital source signals to analog signals. 

430. The controller of claim 427 further comprising a plurality of internal 
audio/video (AV) devices coupled to the control module. 

431 . The controller of claim 427 wherein the IR receiver comprises first 
and second IR detectors, trie first detector coupled to the control module, the 
second detector coupled to the gate, 

432. The controller of claim 427 wherein the IR emitter comprises first 
and second iR repeaters, the first repeater coupled to the control module, the 
second repeater coupled to the gate. 

433. The controller of claim 427 wherein the control module comprises a 
user interface (Ul) module translating user input commands. 

434. ! he controller ot claim 433 wherein me control module further 
snses crsl I ond pt ipi il oevlct trol modyl eei ne U 

module, the first arid second peripheral device control modules converting 
translated user input commands into device appropriate oetpr as I riv« 

435. The controller of claim 434 wherein the first peripheral device control 
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module communicates output messages to drive IR controlled (IRC) peripheral 
devices to n ! emptier tor transmission to ids sRG devices. 

436. Tde controller of claim 435 wherein the first peripheral device control 
module is adapted to close the gate until transmission of output message to the 
IRC device is complete. 

s. 1 fuller 

v,ompf!ftv.:^. <ni issiwiOS; uv,'V><..e w)huo> mou«i« vonv^ftsng uwH^wifcu us«{ mpui 
commands into device appropriate niesssg.es to dnva internal AY devices. 

438., The controller of claim 434 wherein the Ul module comprises 

s first su be i i aether n j pet 

command composes a me^u related action or a direct cev>ce acuon. 

a second sub-module coupled to the first module, the second module 
determining whether a menu related action is a menu display action, a menu 
navigate acuon or e menu device action, arse 

a third sub-module coupled to the first and second modules, the third 
module determining what device connections to make and instructing the first and 
second peripheral device control modules as to what device actions to take. 

439. a, ' n 1 * \ , ' > . >, ? 4 

and IR controlled audio-video and other input devices : comprising the steps of 

receiving user Input commands at a central control unit of a network 

> ^ unit coror. si ed to a translation s du 

and a gate, t N Nation module and gate being coupled to one another and a 
IR transmitter, wherein the network system comprises a mix of 1394 and IR 
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controlled (IRC) input: devices, 

translating the user input commands to device appropriate output 

messages to drive the IRC input devices, 

transmitting device appropriate output messages to the IRC devices, and 
maintaining the gate at a closed state until the transmitting step is 

440, The method of claim 439 further comprising the step of maintaining 
within memory m the central control unit a list of ail input devices, all input device 
connections, and all I/O ports within the network system. 

441 , The method of claim 439 wherein the receiving step further 
comprising the stop of detecting =nput commend -y.u > vers a remote control 
device, 

442, The method of claim 439 wherein the step of translating further 
comprises the step of transforming user input commands for !R controlled devices 
into device appropriate messages comprising oevice specific IR code, 

443, The method of claim 442 further comprising the step of transforming 
user input commands for 1394 devices into device appropriate messages 
formulated by device control modules corresponding to the 1394 devices. 

444, I he method et claim 443 tudner comprising toe step of directing a 
s gnal fro a e sen ce i iput ce-, ce to a sink device 

446, The method of claim 444 further comprising the step of performing 
all necessary device connecting and input switching without further user Input. 
446. The method of claim 439 wherein the translating step further 
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comprises the step of determining If the input command is a direct device action 
event or a menu related event. 

447. The method of claim 446 fiifthef comprising the step of determining 
whether the input command is a menu display event, a menu navigation event, or 
a menu device action event. 

44b\ Tne method ot claim 44/ turther comprising the step of displaying a 
device selection menu on a display screen coupled to the central control unit 

449. The method of claim 448 further comprising the step of Visually 
indicating current system state. 

450. The method of claim 449 further comprising the step of visually 
indicating input source device options. 

451 . The metftoo* of claim 450 further composing the step of visually 
Indicating audio sink device options. 

452. The method of claim 451 farther comprising the step of visually 
indicating which device is the our rent video sink device. 

453. The method of claim 452 further comprising the step of visually 
indicating which device is the current input device and audio sink. 

454. The method of claim 453 further comprising the step of visually 
indicating the existence of a peer-to-peer connection. 

455. The method of claim 453 further comprising the step of visually- 
indicating a device is unavailable as an input device or audio sink. 

456. The method of claim 455 further comprising the step of visually 
Indicating navigation location within the device selection menu. 
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457, The method of cisim 448 further comprising the step of representing 

f > u t ^ * Sr ^ T a 5 - v 

menu. 

458, The method of claim 457 further comprising the step of displaying a 

* - 1 j i I nd mat jink wt fuw as 

part of the ion 

459, The method of claim 45$ further comprising the step of displaying a 
yvindow, 

480. The method of claim 45? further comprising the step of displaying a 
plurality of visual indicators corresponding to a disabled device, current source or 
ssnk device, and menu location. 

<*e \ . A nmuxm u? camming a n«two-K ot o<*vi;,es, u>n»ptfcmg the sstepb 

of 

receiving uniform userinput commands at a centra! control unit of a 
network system, the controi unit comprises a IR defector coupled to a translation 
module and a gate, the translation module and gate being coupled to one another 
and a IR transmitter, wherein the network system comprises a mix of IR controlled 
(IRC) and . m si devices, 

lotwork system, 

based on stored device and device inferconnectivity data, translating the 
user input commands to device appropriate output messages to dove the input 
devices, and 

transmitting device ^ t ^ omom m^sao< : ^ to the IRC devices and 
102 



maintaining the gate at a dosed state until the step of transmitting output 

fnsjSSSgijts to site sRO Ut5VSC0S !S COfnp.itf:v;. 
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